00000001:02000400:1.0F:1788845708.968685:0:3298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788845728.812196:0:3517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788845730.653014:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 573 MB/s 00000001:01000000:2.0F:1788845730.903384:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 559 MB/s 00000001:01000000:2.0:1788845731.152645:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4951 MB/s 00000020:02000000:0.0:1788845731.991366:0:3609:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_105_g5f3dd0c 00000400:02000000:3.0:1788845732.887975:0:3624:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.120@tcp [8/256/0/180] 00008000:02000000:0.0:1788845736.659822:0:3774:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788845795.117658:0:5743:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788845808.253567:0:6493:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788845808.253573:0:6493:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788845808.253575:0:6493:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788845808.253714:0:6493:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ad506c42 00000080:02000400:3.0:1788845808.253726:0:6493:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788845808.274049:0:6493:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788845808.274062:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788845808.274098:0:6493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006ef4465d) 00000020:00000080:3.0:1788845808.274117:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788845808.339273:0:6493:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788845808.339351:0:6493:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788845808.393773:0:6493:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788845808.394029:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788845808.394037:0:6493:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788845808.394049:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138271438 00000020:01000004:2.0:1788845808.394056:0:6493:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788845808.394060:0:6493:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788845808.394065:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ad506c42 from MGS 00000020:01000004:2.0:1788845808.394070:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788845808.394091:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c99f9c19) 00000020:00000080:2.0:1788845808.394103:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788845808.394205:0:6493:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad506c42 from MGS, refs=2 00080000:01000000:2.0:1788845808.394210:0:6493:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788845808.394215:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138271446 00000100:00100000:2.0:1788845808.394303:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788845808.394644:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788845808.394651:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788845808.395082:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788845808.395089:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788845808.396276:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845808.397393:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788845808.397402:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788845808.398258:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788845808.398266:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788845808.398935:0:6493:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788845808.398942:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788845808.400238:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845808.400243:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845808.400245:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845808.400894:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845808.400899:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845808.400900:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845808.401401:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788845808.404570:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788845808.650559:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2823 MB/s 00000001:01000000:3.0:1788845808.902327:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2159 MB/s 00000001:01000000:1.0:1788845809.153335:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 338 MB/s 00000001:01000000:1.0:1788845809.405577:0:6493:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 521 MB/s 00080000:10000000:0.0:1788845809.411231:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788845809.420994:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788845809.421980:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788845809.422028:0:6493:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788845809.422079:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788845809.422225:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788845809.422244:0:6493:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788845809.422780:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845809.422928:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788845809.422940:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788845809.424154:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788845809.424166:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788845809.428826:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788845809.428840:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788845809.429569:0:6512:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788845809.429678:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788845809.429700:0:6493:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.120@tcp' 00000020:01000004:1.0:1788845809.429702:0:6493:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788845809.429755:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.120@tcp (typ=mgc) 00000020:00000080:1.0:1788845809.429773:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.120@tcp (00000000f22ddc91) 00000020:00000080:1.0:1788845809.429789:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788845809.429914:0:6493:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a9632a21@MGC192.168.203.120@tcp: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788845809.430052:0:6493:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.120@tcp-0 is initialized 00000040:01000000:1.0:1788845809.430057:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788845809.432893:0:6513:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788845809.432948:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.120@tcp (uuid a0315653-1ca9-40fd-86ef-b83b7b1cadfd) 00000020:00000080:1.0:1788845809.432968:0:6493:0:(genops.c:1385:class_connect()) connect: client a0315653-1ca9-40fd-86ef-b83b7b1cadfd, cookie 0x21b4d56138271454 00000100:00080000:1.0:1788845809.432979:0:6493:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788845809.432984:0:6493:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import 00000000a9632a21 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788845809.433022:0:6493:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008a248345 x1875740702277760/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788845809.435260:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a248345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3639:1875740702277760:0@lo:250: 00000100:00100000:1.0:1788845809.437558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788845809.437674:0:6493:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS 00000020:01000004:1.0:1788845809.437702:0:6493:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788845809.437709:0:6493:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788845809.437723:0:6493:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007bb44e38) 00000020:00000080:1.0:1788845809.437740:0:6493:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788845809.438571:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702277760 00000100:00100000:2.0:1788845809.438582:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702277760 00000100:00100000:2.0:1788845809.438617:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845809.438623:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003262eb01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1875740702277760:12345-0@lo:250: 00010000:00080000:2.0:1788845809.438646:0:6508:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a0315653-1ca9-40fd-86ef-b83b7b1cadfd@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1788845809.438669:0:6508:0:(genops.c:1385:class_connect()) connect: client a0315653-1ca9-40fd-86ef-b83b7b1cadfd, cookie 0x21b4d56138271462 00000100:00080000:2.0:1788845809.438809:0:6508:0:(import.c:65:import_set_state_nolock()) 0000000068f9986d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845809.438897:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003262eb01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:3639:x1875740702277760:12345-0@lo:250: Request processed in 273us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845809.438905:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845809.439639:0:3639:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788845809.439650:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.120@tcp: connect to target with instance 0 00000100:00080000:0.0:1788845809.439659:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788845809.439663:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788845809.439666:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000a9632a21 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788845809.439669:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788845809.439678:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788845809.439684:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a248345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3639:1875740702277760:0@lo:250: 00000100:00100000:0.0:1788845809.459005:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788845809.459217:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788845809.459223:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788845809.461822:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788845809.461833:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788845809.462213:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788845809.462219:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788845809.463292:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845809.463515:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788845809.464007:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788845809.464729:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788845809.464737:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1788845809.468983:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845809.513266:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845809.514023:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788845809.514031:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788845809.515654:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788845809.515664:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788845809.516290:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845809.516470:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788845809.516475:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788845809.521315:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788845809.521337:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788845809.522164:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845809.522330:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788845809.522334:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788845809.526897:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788845809.526911:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788845809.527689:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845809.528484:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788845809.528503:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788845809.534404:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788845809.534417:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788845809.556244:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845809.556711:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788845809.556718:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788845809.566986:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788845809.567003:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788845809.568089:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788845809.568099:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788845809.569228:0:6493:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788845809.569254:0:6493:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788845809.569260:0:6493:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788845809.569372:0:6493:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788845809.569413:0:6493:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788845809.569417:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788845809.569419:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788845809.569420:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845809.569421:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845809.569423:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845809.569424:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845809.569425:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788845809.569426:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788845809.569428:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845809.569429:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845809.569430:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845809.569431:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788845809.569434:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788845809.569436:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788845809.569437:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788845809.569438:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845809.569439:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845809.569440:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845809.569441:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845809.569441:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788845809.569442:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788845809.569443:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845809.569444:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845809.569445:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845809.569446:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788845809.569486:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788845809.569511:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702277888:0@lo:253: 00000100:00100000:3.0:1788845809.569815:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.569873:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094e587ca going to sleep for 11 seconds 00000100:00100000:0.0:1788845809.569945:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702277888 00000100:00100000:0.0:1788845809.569952:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702277888 00000100:00100000:0.0:1788845809.569999:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845809.570007:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d53dddce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:6493:x1875740702277888:12345-0@lo:253: 20000000:01000000:0.0:1788845809.570050:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788845809.570053:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788845809.574852:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788845809.574924:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788845809.575204:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845809.576177:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788845809.576761:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788845809.576766:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788845809.576782:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788845809.576784:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788845809.576798:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788845809.576995:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845809.577138:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788845809.577151:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788845809.577168:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788845809.577181:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788845809.577195:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788845809.577254:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788845809.577263:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788845809.577275:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788845809.577281:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788845809.577291:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788845809.577295:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788845809.577305:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788845809.577317:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788845809.577359:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788845809.577364:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788845809.577372:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845809.577459:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788845809.577470:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788845809.577484:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788845809.577514:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788845809.577561:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788845809.577570:0:6511:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788845809.577594:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788845809.577613:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788845809.577627:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788845809.577641:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788845809.577655:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788845809.577663:0:6511:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788845809.577694:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788845809.577702:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788845809.577715:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788845809.577728:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788845809.577790:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788845809.577811:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788845809.577818:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788845809.589755:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788845809.589946:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788845809.589974:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:0.0:1788845809.589976:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788845809.589992:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788845809.590003:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788845809.590016:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788845809.590021:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:0.0:1788845809.590035:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788845809.590042:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788845809.590052:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788845809.590065:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788845809.590091:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788845809.590095:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788845809.590098:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788845809.590140:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788845809.590143:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788845809.592023:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788845809.592238:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788845809.592265:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788845809.592279:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788845809.592287:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788845809.592289:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788845809.592663:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788845809.593083:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788845809.593104:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788845809.593117:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788845809.593137:0:6511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845809.593139:0:6511:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788845809.593144:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788845809.593147:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788845809.593151:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788845809.593157:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788845809.594086:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788845809.594207:0:6511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788845809.616110:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788845809.616148:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788845809.616164:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788845809.616184:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788845809.616205:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616221:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616230:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616236:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616242:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616249:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616256:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008005b0fb already unused, calling callback (00000000d91ca842) 00010000:00010000:0.0:1788845809.616259:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616280:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616293:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616299:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.616305:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008005b0fb/0x21b4d56138271469 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788845809.616327:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788845809.638780:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d53dddce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:6493:x1875740702277888:12345-0@lo:253: Request processed in 68767us (68959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845809.638796:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845809.640877:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702277888:0@lo:253: 10000000:01000000:3.0:1788845809.640896:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788845809.640912:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788845809.640914:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788845809.640915:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845809.640917:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788845809.640918:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845809.640919:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845809.640920:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788845809.640922:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788845809.640923:0:6493:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788845809.640924:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845809.640925:0:6493:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788845809.640943:0:6493:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ad506c42 from lustre-MDT0000 10000000:01000000:3.0:1788845809.640975:0:6493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788845809.640977:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788845809.640981:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90e450c6cd28 10000000:01000000:3.0:1788845809.640984:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845809.640991:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90e450c6cd28 from 1 10000000:01000000:3.0:1788845809.640993:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788845809.641027:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.641037:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.641045:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.641070:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278016:0@lo:101: 00000100:00100000:3.0:1788845809.641120:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.641169:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b92d5cfe going to sleep for 11 seconds 00000100:00100000:2.0:1788845809.641226:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702278016 00000100:00100000:2.0:1788845809.641234:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702278016 00000100:00100000:2.0:1788845809.641280:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845809.641288:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b830baeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:6493:x1875740702278016:12345-0@lo:101: 00010000:00010000:2.0:1788845809.641300:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845809.641315:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271470 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.641336:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271470 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.641347:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271470 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.641356:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068910367, rc 0) 00000100:00100000:2.0:1788845809.641573:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b830baeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:6493:x1875740702278016:12345-0@lo:101: Request processed in 285us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845809.641580:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845809.649372:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278016:0@lo:101: 00010000:00010000:3.0:1788845809.649474:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.649518:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.649631:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278144:0@lo:501: 00000100:00100000:3.0:1788845809.650263:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.650382:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b92d5cfe going to sleep for 11 seconds 00000100:00100000:0.0:1788845809.654416:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702278144 00000100:00100000:0.0:1788845809.654431:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702278144 00000100:00100000:0.0:1788845809.654585:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845809.654596:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dbfd203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:6493:x1875740702278144:12345-0@lo:501: 00000100:00100000:0.0:1788845809.655033:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dbfd203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:6493:x1875740702278144:12345-0@lo:501: Request processed in 439us (5312us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845809.655041:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845809.655223:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278144:0@lo:501: 10000000:01000000:3.0:1788845809.655267:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788845809.655287:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.655297:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845809.655307:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e451417000 10000000:01000000:3.0:1788845809.655312:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788845809.655316:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90e451417000 10000000:01000000:3.0:1788845809.655318:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788845809.655321:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90e451417000 from 1 10000000:01000000:3.0:1788845809.655324:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788845809.655353:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000caded926/0x21b4d5613827147e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.655360:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000caded926/0x21b4d5613827147e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.655368:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000caded926/0x21b4d5613827147e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.655397:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278272:0@lo:101: 00000100:00100000:3.0:1788845809.655444:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.655508:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b92d5cfe going to sleep for 11 seconds 00000100:00100000:2.0:1788845809.655570:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702278272 00000100:00100000:2.0:1788845809.655577:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702278272 00000100:00100000:2.0:1788845809.655670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845809.655681:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d530d90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:6493:x1875740702278272:12345-0@lo:101: 00010000:00010000:2.0:1788845809.655692:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845809.655704:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008a70886a/0x21b4d56138271485 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827147e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.655725:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008a70886a/0x21b4d56138271485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827147e expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.655734:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008a70886a/0x21b4d56138271485 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827147e expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.655752:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008a70886a, rc 0) 00000100:00100000:2.0:1788845809.655799:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d530d90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+7:6493:x1875740702278272:12345-0@lo:101: Request processed in 121us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845809.655819:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845809.655884:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278272:0@lo:101: 00010000:00010000:3.0:1788845809.655896:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000caded926/0x21b4d5613827147e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.655903:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000caded926/0x21b4d5613827147e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845809.655914:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788845809.655927:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000caded926/0x21b4d5613827147e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.655933:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000caded926/0x21b4d5613827147e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845809.655939:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788845809.655942:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845809.655946:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90e451417000 10000000:01000000:3.0:1788845809.655948:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788845809.655951:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788845809.655953:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788845809.655965:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.655970:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.655987:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.655997:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278400:0@lo:101: 00000100:00100000:3.0:1788845809.656023:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.660500:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b92d5cfe going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.661158:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702278400 00000100:00100000:1.0:1788845809.661171:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702278400 00000100:00100000:1.0:1788845809.661279:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788845809.661287:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000173e9cea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+7:6493:x1875740702278400:12345-0@lo:101: 00010000:00010000:1.0:1788845809.661312:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845809.661330:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827148c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.661357:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827148c expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.661367:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827148c expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.661376:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019ba5e6d, rc 0) 00000100:00100000:1.0:1788845809.661448:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000173e9cea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+8:6493:x1875740702278400:12345-0@lo:101: Request processed in 162us (5424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.661454:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845809.662878:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278400:0@lo:101: 00010000:00010000:3.0:1788845809.662900:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.662912:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.662984:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278528:0@lo:501: 00000100:00100000:3.0:1788845809.663033:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.663604:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b92d5cfe going to sleep for 11 seconds 00000100:00100000:0.0:1788845809.666020:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702278528 00000100:00100000:0.0:1788845809.666033:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702278528 00000100:00100000:1.0:1788845809.667674:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845809.667687:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f37c32bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+8:6493:x1875740702278528:12345-0@lo:501: 00000100:00100000:1.0:1788845809.667956:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f37c32bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:6493:x1875740702278528:12345-0@lo:501: Request processed in 272us (4922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.667985:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845809.668904:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278528:0@lo:501: 00000100:00100000:3.0:1788845809.668958:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278656:0@lo:503: 00000100:00100000:3.0:1788845809.669015:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.669143:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b92d5cfe going to sleep for 11 seconds 00000100:00100000:2.0:1788845809.669217:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702278656 00000100:00100000:2.0:1788845809.669224:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702278656 00000100:00100000:2.0:1788845809.669262:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845809.669269:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000144417ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:6493:x1875740702278656:12345-0@lo:503: 00000100:00100000:2.0:1788845809.669373:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000144417ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:6493:x1875740702278656:12345-0@lo:503: Request processed in 104us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845809.669380:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845809.669576:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702278656:0@lo:503: 00000100:00100000:2.0:1788845809.670717:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033bb587f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6537:1875740702278784:0@lo:502: 00000100:00100000:2.0:1788845809.670851:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845809.670886:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 00000000097c8976 going to sleep for 11 seconds 00000100:00100000:0.0:1788845809.670941:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702278784 00000100:00100000:0.0:1788845809.670946:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702278784 00000100:00100000:0.0:1788845809.670982:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845809.670988:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e65ab0d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:6537:x1875740702278784:12345-0@lo:502: 00000100:00100000:1.0:1788845809.672443:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e65ab0d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:6537:x1875740702278784:12345-0@lo:502: Request processed in 1451us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.672453:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788845809.672694:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033bb587f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6537:1875740702278784:0@lo:502: 00000020:01000000:2.0:1788845809.672811:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845809.672823:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845809.672825:0:6537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788845809.672830:0:6537:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788845809.672833:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788845809.672848:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000a3d27466) 00000020:00000080:2.0:1788845809.672866:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788845809.672872:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788845809.672949:0:6537:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788845809.672955:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382714a1 00000020:00000080:2.0:1788845809.673282:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788845809.673288:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845809.673296:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845809.673298:0:6537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788845809.673301:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845809.673304:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845809.673305:0:6537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788845809.673308:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788845809.673314:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008b797716) 00000020:00000080:2.0:1788845809.673323:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788845809.673327:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788845809.673328:0:6537:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788845809.673331:0:6537:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788845809.673336:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788845809.673386:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad506c42 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788845809.673398:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000013705021) 00000020:00000080:2.0:1788845809.673471:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788845809.674181:0:6537:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788845809.674189:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382714b6 00000020:00000080:2.0:1788845809.674310:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788845809.674316:0:6537:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788845809.674320:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x21b4d561382714bd 00080000:01000000:2.0:1788845809.674324:0:6537:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788845809.674327:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382714c4 00080000:10000000:2.0:1788845809.674843:0:6537:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788845809.674979:0:6537:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788845809.682980:0:6537:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788845809.762575:0:6537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788845809.762910:0:6537:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788845809.768363:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788845809.768830:0:6537:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788845809.778044:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000085595b86) 00000020:00000080:1.0:1788845809.778076:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788845809.778149:0:6537:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788845809.778157:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382714d2 00000020:00000080:2.0:1788845809.787577:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788845809.790695:0:6537:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788845809.805717:0:6537:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788845809.814236:0:6537:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1788845809.819888:0:6537:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1788845809.836313:0:6537:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788845809.838880:0:6537:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788845809.842441:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x21b4d561382714d9 00000020:00000080:2.0:1788845809.843670:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788845809.843682:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845809.843696:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845809.843699:0:6537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788845809.843703:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845809.843706:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845809.843707:0:6537:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788845809.843710:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788845809.843712:0:6537:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788845809.843714:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845809.843716:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845809.843717:0:6537:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788845809.843719:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845809.843722:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845809.843724:0:6537:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788845809.843727:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788845809.843770:0:6537:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788845809.843822:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033bb587f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6537:1875740702278912:0@lo:502: 00000100:00100000:2.0:1788845809.843899:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845809.843966:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f96a0631 going to sleep for 11 seconds 00000100:00100000:3.0:1788845809.847661:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702278912 00000100:00100000:3.0:1788845809.847677:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702278912 00000100:00100000:3.0:1788845809.847728:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845809.847753:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3cc3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:6537:x1875740702278912:12345-0@lo:502: 00000100:00100000:3.0:1788845809.847919:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3cc3c08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:6537:x1875740702278912:12345-0@lo:502: Request processed in 168us (4019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845809.847926:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845809.847979:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033bb587f pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6537:1875740702278912:0@lo:502: 00000020:01000000:0.0:1788845809.848015:0:6537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845809.848032:0:6537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845809.848035:0:6537:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788845809.848039:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788845809.848179:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788845809.848198:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788845809.848381:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.848394:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845809.848402:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e451417000 from 1 10000000:01000000:3.0:1788845809.848405:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788845809.848436:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.848444:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.848451:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.848465:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279040:0@lo:101: 00000100:00100000:3.0:1788845809.848512:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.849251:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000014570b13 going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.849425:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702279040 00000100:00100000:1.0:1788845809.849433:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702279040 00000100:00100000:1.0:1788845809.849477:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845809.849485:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000701227ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:6493:x1875740702279040:12345-0@lo:101: 00010000:00010000:1.0:1788845809.849507:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845809.849547:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382714e0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.849573:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382714e0 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.849582:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382714e0 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.849590:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049199510, rc 0) 00000100:00100000:1.0:1788845809.849643:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000701227ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:6493:x1875740702279040:12345-0@lo:101: Request processed in 160us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.849663:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788845809.849714:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a507240 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279040:0@lo:101: 00010000:00010000:2.0:1788845809.849730:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.849740:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845809.850381:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b3b7418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279168:0@lo:256: 00000100:00100000:2.0:1788845809.850427:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845809.850543:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0b4853a going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.856958:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702279168 00000100:00100000:1.0:1788845809.856974:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702279168 00000100:00100000:1.0:1788845809.857040:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845809.857049:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ea2b8f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:6493:x1875740702279168:12345-0@lo:256: 20000000:01000000:1.0:1788845809.857073:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788845809.857078:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788845809.857371:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ea2b8f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:6493:x1875740702279168:12345-0@lo:256: Request processed in 323us (6943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.857380:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845809.857989:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b3b7418 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279168:0@lo:256: 10000000:01000000:3.0:1788845809.859049:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788845809.859069:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.859091:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845809.859099:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451417000 from 1 10000000:01000000:3.0:1788845809.859102:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845809.859137:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.859143:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.859152:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.859172:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279296:0@lo:101: 00000100:00100000:3.0:1788845809.859228:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.859516:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bec5eccc going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.862403:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702279296 00000100:00100000:1.0:1788845809.862419:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702279296 00000100:00100000:1.0:1788845809.862561:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788845809.862573:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0336e5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:6493:x1875740702279296:12345-0@lo:101: 00010000:00010000:1.0:1788845809.862588:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845809.862616:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382714ee expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.862642:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382714ee expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.862651:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382714ee expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.862660:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1760620, rc 0) 00000100:00100000:1.0:1788845809.862731:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0336e5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:6493:x1875740702279296:12345-0@lo:101: Request processed in 161us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.862737:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845809.862954:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279296:0@lo:101: 00010000:00010000:3.0:1788845809.862972:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.862982:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.863067:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279424:0@lo:501: 00000100:00100000:3.0:1788845809.863100:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.863594:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bec5eccc going to sleep for 11 seconds 00000100:00100000:2.0:1788845809.863742:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702279424 00000100:00100000:2.0:1788845809.863749:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702279424 00000100:00100000:2.0:1788845809.863888:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845809.863896:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015591709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:6493:x1875740702279424:12345-0@lo:501: 00000100:00100000:2.0:1788845809.864309:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015591709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:6493:x1875740702279424:12345-0@lo:501: Request processed in 413us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845809.864317:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788845809.864407:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279424:0@lo:501: 00000100:00100000:3.0:1788845809.864442:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279552:0@lo:503: 00000100:00100000:3.0:1788845809.864482:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.864512:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bec5eccc going to sleep for 11 seconds 00000100:00100000:2.0:1788845809.864588:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702279552 00000100:00100000:2.0:1788845809.864593:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702279552 00000100:00100000:2.0:1788845809.864711:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845809.864717:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc6acdca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:6493:x1875740702279552:12345-0@lo:503: 00000040:00080000:2.0:1788845809.864868:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845809.864979:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc6acdca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:6493:x1875740702279552:12345-0@lo:503: Request processed in 263us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845809.864986:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788845809.865132:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279552:0@lo:503: 00000040:00080000:3.0:1788845809.869419:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788845809.870897:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788845809.870931:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845809.870998:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.871010:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845809.871200:0:6493:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788845809.871204:0:6493:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e451417000 10000000:01000000:3.0:1788845809.871206:0:6493:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e451417000 10000000:01000000:3.0:1788845809.871210:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845809.871217:0:6493:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e451417000 from 1 10000000:01000000:3.0:1788845809.871219:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788845809.871273:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.871281:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.871293:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.871314:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279680:0@lo:101: 00000100:00100000:3.0:1788845809.871382:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.871436:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074f802ac going to sleep for 11 seconds 00000100:00100000:2.0:1788845809.873050:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702279680 00000100:00100000:2.0:1788845809.873065:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702279680 00000100:00100000:2.0:1788845809.873132:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845809.873141:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b272bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:6493:x1875740702279680:12345-0@lo:101: 00010000:00010000:2.0:1788845809.873156:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845809.873173:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382714fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.873215:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382714fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.873226:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382714fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.873234:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050bb8374, rc 0) 00000100:00100000:2.0:1788845809.873306:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b272bd3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6493:x1875740702279680:12345-0@lo:101: Request processed in 167us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845809.873314:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845809.873553:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279680:0@lo:101: 00010000:00010000:3.0:1788845809.873573:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845809.873593:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845809.873676:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279808:0@lo:501: 00000100:00100000:3.0:1788845809.873710:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.873734:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074f802ac going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.873797:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702279808 00000100:00100000:1.0:1788845809.873802:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702279808 00000100:00100000:1.0:1788845809.873828:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788845809.873834:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3e548c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6493:x1875740702279808:12345-0@lo:501: 00000100:00100000:1.0:1788845809.873969:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3e548c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6493:x1875740702279808:12345-0@lo:501: Request processed in 135us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.873976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845809.874151:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279808:0@lo:501: 00000100:00100000:3.0:1788845809.874179:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279936:0@lo:503: 00000100:00100000:3.0:1788845809.874219:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.874244:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074f802ac going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.874290:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702279936 00000100:00100000:1.0:1788845809.874294:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702279936 00000100:00100000:1.0:1788845809.874328:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788845809.874334:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009972914a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6493:x1875740702279936:12345-0@lo:503: 00000100:00100000:1.0:1788845809.874409:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009972914a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6493:x1875740702279936:12345-0@lo:503: Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.874415:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788845809.874497:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702279936:0@lo:503: 00000100:00100000:3.0:1788845809.875690:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6542:1875740702280064:0@lo:502: 00000100:00100000:3.0:1788845809.875761:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.875799:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set 0000000094e587ca going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.875954:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702280064 00000100:00100000:1.0:1788845809.875960:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702280064 00000100:00100000:1.0:1788845809.876000:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788845809.876007:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003239fc95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6542:x1875740702280064:12345-0@lo:502: 00000100:00100000:1.0:1788845809.876230:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003239fc95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6542:x1875740702280064:12345-0@lo:502: Request processed in 224us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845809.876237:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788845809.876318:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6542:1875740702280064:0@lo:502: 00000020:01000004:3.0:1788845809.876372:0:6542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788845809.876386:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005a00c75b) 00000020:00000080:3.0:1788845809.876403:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788845809.876479:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ad506c42 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788845809.876483:0:6542:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ad506c42 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788845809.876499:0:6542:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ad506c42 4 00010000:00080000:3.0:1788845809.876557:0:6542:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000eba8d041@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1788845809.880715:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788845809.880919:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788845809.880959:0:6542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788845809.880984:0:6542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x21b4d56138271511 00000100:00080000:3.0:1788845809.880994:0:6542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845809.880999:0:6542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000eba8d041 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788845809.881146:0:6542:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000054a07e07 x1875740702280192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788845809.881165:0:6542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788845809.881347:0:6542:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003877a5d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6542:1875740702280320:0@lo:502: 00000100:00100000:3.0:1788845809.881422:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.881464:0:6542:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007cf70ed going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.882048:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702280192:0@lo:38: 00000100:00100000:1.0:1788845809.882087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845809.882476:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702280192 00000100:00100000:3.0:1788845809.882483:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702280192 00000100:00100000:3.0:1788845809.882547:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845809.882552:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49e948b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702280192:12345-0@lo:38: 00000100:00100000:3.0:1788845809.882606:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49e948b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702280192:12345-0@lo:38: Request processed in 53us (518us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788845809.882612:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845809.882646:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788845809.882653:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000eba8d041 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788845809.882656:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788845809.882659:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702280192:0@lo:38: 00000100:00100000:3.0:1788845809.883682:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702280320 00000100:00100000:3.0:1788845809.883692:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702280320 00000100:00100000:3.0:1788845809.884263:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788845809.884275:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f54a832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6542:x1875740702280320:12345-0@lo:502: 00000100:00100000:3.0:1788845809.884430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f54a832 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6542:x1875740702280320:12345-0@lo:502: Request processed in 159us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845809.885643:0:6542:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003877a5d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6542:1875740702280320:0@lo:502: 00000040:00080000:2.0:1788845809.885685:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788845809.886043:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788845809.886063:0:6493:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788845809.886088:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.886112:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788845809.886161:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788845809.886163:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788845809.886165:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845809.886166:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845809.886167:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845809.886168:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845809.886169:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788845809.886170:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788845809.886171:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788845809.886173:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788845809.886174:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845809.886175:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788845809.886178:0:6493:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788845809.886181:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788845809.886182:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788845809.886183:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845809.886184:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845809.886185:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845809.886186:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845809.886186:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788845809.886187:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788845809.886188:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788845809.886189:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788845809.886190:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845809.886190:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788845809.886209:0:6493:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788845809.886225:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061575257 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702280448:0@lo:253: 00000100:00100000:1.0:1788845809.886281:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845809.886313:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000003f127923 going to sleep for 11 seconds 00000100:00100000:1.0:1788845809.886330:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702280448 00000100:00100000:1.0:1788845809.886336:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702280448 00000100:00100000:1.0:1788845809.886372:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788845809.886388:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b35c3ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:6493:x1875740702280448:12345-0@lo:253: 20000000:01000000:1.0:1788845809.886411:0:6508:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788845809.886424:0:6508:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788845809.888879:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 20000000:01000000:0.0:1788845809.896155:0:6508:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788845809.896174:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788845809.896877:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b35c3ae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6493:x1875740702280448:12345-0@lo:253: Request processed in 10485us (10591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845809.896892:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845809.897229:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061575257 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6493:1875740702280448:0@lo:253: 10000000:01000000:3.0:1788845809.897244:0:6493:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788845809.897247:0:6493:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788845809.897249:0:6493:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788845809.897250:0:6493:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845809.897251:0:6493:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845809.897253:0:6493:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845809.897254:0:6493:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845809.897255:0:6493:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788845809.897257:0:6493:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788845809.897258:0:6493:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845809.897260:0:6493:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845809.897261:0:6493:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845809.897262:0:6493:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788845809.897278:0:6493:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788845809.897608:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788845809.897613:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788845809.897633:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.897648:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382714e0 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.897656:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.897689:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382714e0 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845809.897706:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382714e0 expref: 11 pid: 6511 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845809.897719:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bdee7bbd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702280576:0@lo:104: 00000100:00100000:1.0:1788845809.898201:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845809.898258:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f137148 going to sleep for 11 seconds 00000100:00100000:0.0:1788845809.898977:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702280576 00000100:00100000:0.0:1788845809.898987:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702280576 00000100:00100000:0.0:1788845809.899117:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845809.899127:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ec40421 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6531:x1875740702280576:12345-0@lo:104: 00010000:00010000:0.0:1788845809.899141:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.899206:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845809.899211:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ec40421 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6531:x1875740702280576:12345-0@lo:104: Request processed in 87us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845809.899217:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845809.899254:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bdee7bbd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702280576:0@lo:104: 00010000:00010000:0.0:1788845809.899273:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.899291:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845809.899304:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.899311:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002d72223e already unused, calling callback (00000000bd0b84b2) 10000000:00010000:0.0:1788845809.899314:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.899322:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845809.899328:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845809.899333:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845809.899378:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.899385:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845809.899410:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.899416:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000002d72223e/0x21b4d561382714e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382714e7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.899434:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845809.899436:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845809.899438:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845809.899677:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000734e6da8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702280704:0@lo:103: 00000100:00100000:2.0:1788845809.899716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845809.902402:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702280704 00000100:00100000:0.0:1788845809.902416:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702280704 00010000:00010000:0.0:1788845809.902450:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382714e0 expref: 12 pid: 6511 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845809.902517:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845809.904582:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3884d2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:3641:x1875740702280704:12345-0@lo:103: 00010000:00010000:0.0:1788845809.904607:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845809.904616:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382714e0 expref: 12 pid: 6511 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904632:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382714e0 expref: 12 pid: 6511 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904651:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000049199510/0x21b4d561382714e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382714e0 expref: 12 pid: 6511 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904667:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904674:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788845809.904689:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007076048s 00010000:00010000:0.0:1788845809.904692:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904698:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904703:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904708:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904740:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a24d407 already unused, calling callback (00000000d91ca842) 00010000:00010000:0.0:1788845809.904743:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904750:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904771:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845809.904888:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845809.904963:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3884d2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:3641:x1875740702280704:12345-0@lo:103: Request processed in 395us (5246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845809.904971:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845809.905101:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000734e6da8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702280704:0@lo:103: 00010000:00010000:2.0:1788845809.905719:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.905736:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845809.905743:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004a24d407/0x21b4d56138271518 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788845809.906559:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788845809.906742:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788845809.906924:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788845809.907054:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788845809.907227:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788845809.907375:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788845809.908850:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788845809.909018:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788845809.909797:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788845809.909968:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788845809.910421:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788845809.910637:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788845809.916408:0:6493:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788845809.930900:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788845809.931324:0:6548:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788845809.933713:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788845809.934687:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788845809.937263:0:6547:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788845809.937273:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:2.0:1788845809.937323:0:6493:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788845809.937671:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788845809.937948:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845809.941056:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788845809.941665:0:6493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788845809.941700:0:6493:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788845809.949846:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788845809.950328:0:6493:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:1.0:1788845809.952592:0:6548:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1788845809.955269:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788845809.955619:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788845809.959168:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788845809.959364:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788845809.959510:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788845809.959686:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788845809.959841:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788845809.959990:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788845809.960146:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788845809.960282:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788845809.960460:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788845809.960636:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788845809.960758:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788845809.960883:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788845809.961024:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788845809.961148:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788845809.961414:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788845809.961595:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788845809.961711:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788845809.961832:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788845809.961964:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788845809.962130:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788845809.962256:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788845809.962418:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788845809.964714:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788845809.964900:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000040:00080000:1.0:1788845809.965015:0:6548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:3.0:1788845809.965027:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000004:00080000:1.0:1788845809.965173:0:6548:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00100000:10000000:3.0:1788845809.965175:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000004:00080000:1.0:1788845809.965178:0:6548:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788845809.967756:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788845809.968057:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788845809.968186:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788845809.969062:0:6493:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788845809.969460:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788845809.975997:0:6493:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788845809.976037:0:6493:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f081c4f988 00100000:10000000:3.0:1788845809.976054:0:6493:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788845809.983994:0:6493:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788845809.984013:0:6493:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788845809.984033:0:6493:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788845809.984050:0:6493:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788845809.984789:0:6493:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788845809.984951:0:6493:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788845810.489697:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845811.515550:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845812.540603:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845813.562629:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845814.334898:0:6792:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788845814.590128:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845815.114841:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000734e6da8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702280832:0@lo:400: 00000100:00100000:3.0:1788845815.115095:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788845815.116342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788845815.116350:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788845815.116353:0:37:0:(import.c:65:import_set_state_nolock()) 00000000eba8d041 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788845815.116363:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000eba8d041 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788845815.116399:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001e9267a2 x1875740702280960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788845815.116569:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702280832 00000100:00100000:1.0:1788845815.116579:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702280832 00000100:00100000:1.0:1788845815.116632:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788845815.116640:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c84e32b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:3642:x1875740702280832:12345-0@lo:400: 00000100:00100000:1.0:1788845815.116721:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c84e32b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:3642:x1875740702280832:12345-0@lo:400: Request processed in 82us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845815.116729:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788845815.116799:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000734e6da8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702280832:0@lo:400: 00000100:00100000:1.0:1788845815.116981:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001e9267a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702280960:0@lo:38: 00000100:00100000:1.0:1788845815.117014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845815.117067:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702280960 00000100:00100000:1.0:1788845815.117071:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702280960 00000100:00100000:1.0:1788845815.117090:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845815.117095:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4cc46c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702280960:12345-0@lo:38: 00010000:00080000:1.0:1788845815.117128:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788845815.117168:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x21b4d5613827151f 00000004:00100000:1.0:1788845815.117210:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788845815.117320:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000e5b6875f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845815.117372:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4cc46c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875740702280960:12345-0@lo:38: Request processed in 276us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845815.117378:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788845815.117406:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001e9267a2 x1875740702280960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788845815.117419:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788845815.117438:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788845815.117442:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788845815.117444:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000eba8d041 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788845815.117459:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001e9267a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702280960:0@lo:38: 00000020:00000004:1.0:1788845815.256042:0:6845:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788845815.256328:0:6845:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788845815.614200:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845816.636935:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845817.658475:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788845817.796370:0:6946:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788845817.796765:0:6946:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788845818.682085:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788845818.682172:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788845818.682177:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e451417000 from 3 10000000:01000000:3.0:1788845818.682183:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788845818.682228:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845818.682619:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845818.682631:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845818.682655:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702281088:0@lo:101: 00000100:00100000:3.0:1788845818.682768:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845818.682826:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075d2bb6f going to sleep for 11 seconds 00000100:00100000:1.0:1788845818.683104:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702281088 00000100:00100000:1.0:1788845818.683112:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702281088 00000100:00100000:1.0:1788845818.683159:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845818.683166:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be36e3c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:6513:x1875740702281088:12345-0@lo:101: 00010000:00010000:1.0:1788845818.683180:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845818.683195:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271526 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845818.683218:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271526 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845818.683229:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271526 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845818.683249:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000927c35, rc 0) 00000100:00100000:1.0:1788845818.683323:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be36e3c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6513:x1875740702281088:12345-0@lo:101: Request processed in 147us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845818.683330:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788845818.683570:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702281088:0@lo:101: 00010000:00010000:3.0:1788845818.683585:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845818.683593:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845818.683647:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702281216:0@lo:256: 00000100:00100000:3.0:1788845818.683681:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845818.683702:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075d2bb6f going to sleep for 11 seconds 00000100:00100000:1.0:1788845818.683828:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702281216 00000100:00100000:1.0:1788845818.683832:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702281216 00000100:00100000:1.0:1788845818.683868:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788845818.683875:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000090039b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6513:x1875740702281216:12345-0@lo:256: 20000000:01000000:1.0:1788845818.683888:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788845818.683905:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788845818.683908:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788845818.690096:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000090039b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:6513:x1875740702281216:12345-0@lo:256: Request processed in 6214us (6407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845818.690112:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845818.692230:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702281216:0@lo:256: 10000000:01000000:3.0:1788845818.692500:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788845818.692509:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845818.696740:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845819.710960:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845820.219753:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845820.219776:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702281344:0@lo:400: 00000100:00100000:0.0:1788845820.219849:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845820.219912:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845820.219921:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a000f61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702281472:0@lo:400: 00000100:00100000:0.0:1788845820.219954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845820.219994:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702281472 00000100:00100000:0.0:1788845820.220001:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702281472 00000100:00100000:0.0:1788845820.220044:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845820.220051:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b16490c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702281472:12345-0@lo:400: 00000100:00100000:0.0:1788845820.220101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b16490c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702281472:12345-0@lo:400: Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845820.220108:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788845820.220145:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001a000f61 x1875740702281472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845820.220164:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a000f61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702281472:0@lo:400: 00000100:00100000:3.0:1788845820.220221:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702281344 00000100:00100000:3.0:1788845820.220226:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702281344 00000100:00100000:3.0:1788845820.220261:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788845820.220268:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9994471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:3642:x1875740702281344:12345-0@lo:400: 00000100:00100000:3.0:1788845820.220309:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9994471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:3642:x1875740702281344:12345-0@lo:400: Request processed in 42us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845820.220316:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845820.220383:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054a07e07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702281344:0@lo:400: 00010000:00010000:1.0:1788845820.731455:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845821.753712:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845822.777715:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845823.810643:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845824.829571:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845825.340768:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845825.340784:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002334548b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702281728:0@lo:400: 00000100:00100000:3.0:1788845825.340790:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e86522c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702281600:0@lo:400: 00000100:00100000:2.0:1788845825.342034:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845825.342118:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702281728 00000100:00100000:2.0:1788845825.342126:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702281728 00000100:00100000:2.0:1788845825.342172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845825.342180:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077491b1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702281728:12345-0@lo:400: 00000100:00100000:2.0:1788845825.342240:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077491b1a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702281728:12345-0@lo:400: Request processed in 61us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845825.342248:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788845825.342289:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002334548b x1875740702281728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845825.342302:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002334548b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702281728:0@lo:400: 00000100:00100000:3.0:1788845825.343046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845825.343250:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702281600 00000100:00100000:0.0:1788845825.343257:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702281600 00000100:00100000:0.0:1788845825.343301:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845825.343309:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1f445ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:3640:x1875740702281600:12345-0@lo:400: 00000100:00100000:3.0:1788845825.343377:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e86522c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702281600:0@lo:400: 00000100:00100000:0.0:1788845825.343604:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1f445ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:3640:x1875740702281600:12345-0@lo:400: Request processed in 295us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845825.343619:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788845825.857984:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788845826.181606:0:7444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788845826.181610:0:7444:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788845826.181612:0:7444:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788845826.181750:0:7444:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b8799553 00000020:01000004:3.0:1788845826.181766:0:7444:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788845826.181776:0:7444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788845826.181788:0:7444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000938ad807) 00000020:00000080:3.0:1788845826.181805:0:7444:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788845826.243546:0:7444:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788845826.243622:0:7444:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788845826.267492:0:7444:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788845826.267988:0:7444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788845826.268003:0:7444:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788845826.268015:0:7444:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d5613827153b 00000020:01000004:0.0:1788845826.268021:0:7444:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788845826.268047:0:7444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788845826.268051:0:7444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788845826.268056:0:7444:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788845826.268089:0:7444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788845826.268092:0:7444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788845826.283139:0:7444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788845826.283173:0:7444:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788845826.283177:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788845826.283178:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788845826.283180:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845826.283181:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845826.283182:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845826.283183:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845826.283184:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845826.283186:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845826.283187:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845826.283188:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845826.283189:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788845826.283192:0:7444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788845826.283194:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845826.283195:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788845826.283196:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845826.283197:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845826.283198:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845826.283199:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845826.283199:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845826.283200:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845826.283201:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845826.283202:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845826.283206:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788845826.283229:0:7444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788845826.283244:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ddd3de97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702281856:0@lo:253: 00000100:00100000:0.0:1788845826.283306:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845826.283437:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000353aa438 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.283814:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702281856 00000100:00100000:1.0:1788845826.283822:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702281856 00000100:00100000:1.0:1788845826.283954:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845826.283963:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000416884f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702281856:12345-0@lo:253: 20000000:01000000:1.0:1788845826.284006:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788845826.284011:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788845826.284015:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788845826.284018:0:6508:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788845826.284051:0:6508:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788845826.284247:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845826.284449:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788845826.284462:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788845826.284480:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788845826.284505:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788845826.284542:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788845826.284597:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788845826.284605:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788845826.284617:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788845826.284626:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788845826.284637:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788845826.284642:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788845826.284654:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788845826.284687:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788845826.284772:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788845826.284778:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:1.0:1788845826.284785:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788845826.284788:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788845826.284794:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788845826.284797:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:1.0:1788845826.284803:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788845826.284806:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788845826.284812:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788845826.284819:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788845826.284824:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788845826.284867:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788845826.284872:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788845826.284948:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788845826.284967:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788845826.284984:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788845826.284990:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788845826.285003:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788845826.285022:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788845826.285027:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1788845826.285053:0:6508:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788845826.285059:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788845826.285775:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788845826.286360:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788845826.286397:0:6508:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:0.0:1788845826.286399:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788845826.286415:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788845826.286422:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788845826.286435:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788845826.286440:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:0.0:1788845826.286460:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788845826.286469:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788845826.286481:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788845826.286495:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788845826.286806:0:6508:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788845826.286816:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788845826.287255:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788845826.287465:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788845826.287484:0:6508:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.120@tcp for mdt 20000000:01000000:0.0:1788845826.287486:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788845826.287501:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788845826.287506:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788845826.288251:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788845826.288263:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:0.0:1788845826.288277:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788845826.288284:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788845826.288295:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788845826.288310:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788845826.288331:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788845826.288343:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788845826.288346:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788845826.288402:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788845826.288405:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788845826.288825:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788845826.288847:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788845826.288861:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788845826.289155:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788845826.289175:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788845826.289191:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788845826.289201:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788845826.289202:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788845826.291002:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788845826.291040:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788845826.291053:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788845826.291236:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788845826.291258:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788845826.291281:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788845826.291294:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788845826.291296:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788845826.291617:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845826.291632:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845826.291643:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788845826.291759:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788845826.291775:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788845826.291786:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788845826.291799:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788845826.291801:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788845826.291806:0:6508:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788845826.291811:0:6508:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788845826.292150:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788845826.292235:0:6508:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788845826.303717:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788845826.303988:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.304008:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271470 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.304016:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827148c expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.304021:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382714fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.304028:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.304065:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382714fc expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.304080:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382714fc expref: 12 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845826.304094:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000784d018f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702281984:0@lo:104: 00000100:00100000:3.0:1788845826.304159:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845826.304219:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827148c expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.304227:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827148c expref: 12 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845826.304235:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702282112:0@lo:104: 00000100:00100000:3.0:1788845826.304256:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845826.304302:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271470 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.304310:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271470 expref: 12 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845826.304319:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097a9a4f6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702282240:0@lo:104: 00000100:00100000:0.0:1788845826.304324:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702281984 00000100:00100000:0.0:1788845826.304334:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702281984 00000100:00100000:3.0:1788845826.304342:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.304352:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089c0cef9 going to sleep for 11 seconds 00000100:00100000:0.0:1788845826.304398:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702282112 00000100:00100000:0.0:1788845826.304401:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702282112 00000100:00100000:0.0:1788845826.304413:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702282240 00000100:00100000:0.0:1788845826.304415:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702282240 00000100:00100000:0.0:1788845826.304427:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845826.304434:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d91ddf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:6508:x1875740702281984:12345-0@lo:104: 00010000:00010000:0.0:1788845826.304457:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304545:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845826.304552:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d91ddf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:6508:x1875740702281984:12345-0@lo:104: Request processed in 118us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845826.304560:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845826.304580:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845826.304586:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000876a81bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702282112:12345-0@lo:104: 00000100:00100000:3.0:1788845826.304588:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000784d018f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702281984:0@lo:104: 00010000:00010000:0.0:1788845826.304595:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304640:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788845826.304652:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000876a81bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702282112:12345-0@lo:104: Request processed in 67us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845826.304658:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845826.304671:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845826.304677:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009f1f583 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702282240:12345-0@lo:104: 00010000:00010000:0.0:1788845826.304683:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304711:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788845826.304715:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009f1f583 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702282240:12345-0@lo:104: Request processed in 40us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845826.304721:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788845826.304735:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788845826.304739:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304747:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d91c3eb0 already unused, calling callback (00000000bd0b84b2) 10000000:00010000:0.0:1788845826.304750:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304758:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845826.304764:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845826.304770:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845826.304795:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304811:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845826.304830:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304842:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000d91c3eb0/0x21b4d561382714fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271503 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304856:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788845826.304859:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304865:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c8817f5f already unused, calling callback (00000000bd0b84b2) 10000000:00010000:0.0:1788845826.304868:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.304873:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845826.304879:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845826.304883:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788845826.304931:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702282112:0@lo:104: 00000100:00100000:3.0:1788845826.304940:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097a9a4f6 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702282240:0@lo:104: 00010000:00010000:2.0:1788845826.304962:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845826.304964:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.306068:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845826.306086:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b5dbd10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702282368:0@lo:103: 00000100:00100000:2.0:1788845826.306136:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.306184:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702282368 00000100:00100000:1.0:1788845826.306192:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702282368 00010000:00010000:1.0:1788845826.306224:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382714fc expref: 13 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845826.306290:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845826.306296:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002334548b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:3642:x1875740702282368:12345-0@lo:103: 00010000:00010000:1.0:1788845826.306307:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845826.306311:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382714fc expref: 13 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.306321:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382714fc expref: 13 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.306335:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000050bb8374/0x21b4d56138271503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382714fc expref: 13 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.306348:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845826.306390:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002334548b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:3642:x1875740702282368:12345-0@lo:103: Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.306406:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845826.306438:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b5dbd10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702282368:0@lo:103: 00010000:00010000:0.0:1788845826.306506:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.306515:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845826.306547:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.306553:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000c8817f5f/0x21b4d5613827148c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271493 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845826.306558:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004305bbac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702282496:0@lo:103: 00010000:00010000:0.0:1788845826.306577:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845826.306579:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845826.306580:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845826.306589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845826.306633:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702282496 00000100:00100000:0.0:1788845826.306637:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702282496 00010000:00010000:0.0:1788845826.306657:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827148c expref: 12 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845826.306678:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788845826.306684:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ab1e689 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:3640:x1875740702282496:12345-0@lo:103: 00010000:00010000:0.0:1788845826.306693:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845826.306696:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827148c expref: 12 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.306704:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827148c expref: 12 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.306715:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019ba5e6d/0x21b4d56138271493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827148c expref: 12 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.306724:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788845826.306748:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845826.306755:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845826.306761:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ab1e689 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:3640:x1875740702282496:12345-0@lo:103: Request processed in 76us (171us total) trans 0 rc 0/0 00010000:00010000:1.0:1788845826.306769:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006fb123d9 already unused, calling callback (00000000bd0b84b2) 00000100:00100000:0.0:1788845826.306773:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:00010000:1.0:1788845826.306774:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.306782:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845826.306788:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845826.306794:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788845826.306802:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004305bbac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702282496:0@lo:103: 00010000:00010000:1.0:1788845826.306809:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.306816:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845826.306827:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.306832:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000006fb123d9/0x21b4d56138271470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271477 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.306855:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845826.306857:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845826.306858:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845826.306863:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845826.306864:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845826.307003:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019d869f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702282624:0@lo:103: 00000100:00100000:0.0:1788845826.307233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.308904:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702282624 00000100:00100000:1.0:1788845826.308916:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702282624 00010000:00010000:1.0:1788845826.308952:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271470 expref: 11 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845826.309192:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845826.309201:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004305bbac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:3641:x1875740702282624:12345-0@lo:103: 00010000:00010000:1.0:1788845826.309214:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845826.309218:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271470 expref: 11 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309228:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271470 expref: 11 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309243:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068910367/0x21b4d56138271477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271470 expref: 11 pid: 6509 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309258:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309266:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309280:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309301:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309307:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309312:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309320:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ccecf83c already unused, calling callback (00000000d91ca842) 00010000:00010000:1.0:1788845826.309324:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309331:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309357:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.309386:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845826.309453:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004305bbac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:3641:x1875740702282624:12345-0@lo:103: Request processed in 254us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.309460:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788845826.309512:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.309577:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.309582:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ccecf83c/0x21b4d56138271542 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788845826.309597:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788845826.309638:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019d869f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702282624:0@lo:103: 00000100:00100000:2.0:1788845826.317035:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000416884f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:7444:x1875740702281856:12345-0@lo:253: Request processed in 33067us (33722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845826.317052:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788845826.317092:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ddd3de97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702281856:0@lo:253: 10000000:01000000:0.0:1788845826.317110:0:7444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788845826.317114:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788845826.317116:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788845826.317118:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845826.317119:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788845826.317121:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845826.317122:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845826.317123:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788845826.317125:0:7444:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788845826.317126:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845826.317128:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788845826.317147:0:7444:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b8799553 from lustre-MDT0001 10000000:01000000:0.0:1788845826.317174:0:7444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788845826.317177:0:7444:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788845826.317183:0:7444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e450c6cd28 local copy 10000000:01000000:0.0:1788845826.317187:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788845826.317217:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.317227:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.317236:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845826.317253:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ddd3de97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702282752:0@lo:101: 00000100:00100000:0.0:1788845826.317291:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845826.317382:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000353aa438 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.317454:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702282752 00000100:00100000:1.0:1788845826.317461:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702282752 00000100:00100000:1.0:1788845826.317507:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845826.317516:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000629bb213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:7444:x1875740702282752:12345-0@lo:101: 00010000:00010000:1.0:1788845826.317567:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845826.317581:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000065c6b23/0x21b4d56138271550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271549 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.317612:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000065c6b23/0x21b4d56138271550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271549 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.317622:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000065c6b23/0x21b4d56138271550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271549 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.317631:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000065c6b23, rc 0) 00000100:00100000:1.0:1788845826.317666:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000629bb213 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:7444:x1875740702282752:12345-0@lo:101: Request processed in 151us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.317672:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788845826.317907:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ddd3de97 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702282752:0@lo:101: 00010000:00010000:2.0:1788845826.317921:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.317931:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.318041:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702282880:0@lo:501: 00000100:00100000:2.0:1788845826.318070:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.318101:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000860b1c68 going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.318405:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702282880 00000100:00100000:3.0:1788845826.318411:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702282880 00000100:00100000:3.0:1788845826.318508:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788845826.318515:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b590b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:7444:x1875740702282880:12345-0@lo:501: 00000100:00100000:3.0:1788845826.318628:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b590b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:7444:x1875740702282880:12345-0@lo:501: Request processed in 115us (558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845826.318637:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788845826.318704:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702282880:0@lo:501: 10000000:01000000:2.0:1788845826.318719:0:7444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788845826.318736:0:7444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788845826.318741:0:7444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.318750:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.318756:0:7444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.318779:0:7444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788845826.318805:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e47518c000 10000000:01000000:2.0:1788845826.318809:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788845826.318814:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90e450c6cd28 10000000:01000000:2.0:1788845826.318817:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788845826.318820:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90e450c6cd28 from 1 10000000:01000000:2.0:1788845826.318832:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788845826.318853:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000068910367/0x21b4d56138271557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.318861:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000068910367/0x21b4d56138271557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.318869:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000068910367/0x21b4d56138271557 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.318881:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283008:0@lo:101: 00010000:00010000:0.0:1788845826.318905:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845826.318911:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.318922:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845826.318935:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edd8c2a1 already unused, calling callback (00000000bd0b84b2) 10000000:00010000:0.0:1788845826.318938:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.318946:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845826.318952:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845826.318958:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845826.318978:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.318983:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845826.319002:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.319008:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000edd8c2a1/0x21b4d56138271549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d56138271550 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.319024:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845826.319025:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845826.319027:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845826.319037:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6c8acbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702283136:0@lo:103: 00000100:00100000:0.0:1788845826.319067:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.320702:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702283008 00000100:00100000:1.0:1788845826.320717:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702283008 00000100:00100000:2.0:1788845826.320743:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4522a50 going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.320808:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702283136 00000100:00100000:3.0:1788845826.320813:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702283136 00000100:00100000:1.0:1788845826.320850:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788845826.320859:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c702359 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:7444:x1875740702283008:12345-0@lo:101: 00010000:00010000:1.0:1788845826.320873:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845826.320889:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005141c6d2/0x21b4d5613827155e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271557 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845826.320896:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845826.320907:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008346a7ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:3642:x1875740702283136:12345-0@lo:103: 00010000:00010000:1.0:1788845826.320930:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005141c6d2/0x21b4d5613827155e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271557 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.320934:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845826.320950:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000065c6b23/0x21b4d56138271550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271549 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.320966:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845826.321031:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008346a7ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:3642:x1875740702283136:12345-0@lo:103: Request processed in 127us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.321039:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788845826.321168:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005141c6d2/0x21b4d5613827155e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271557 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.321177:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005141c6d2, rc 0) 00000100:00100000:3.0:1788845826.321216:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6c8acbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702283136:0@lo:103: 00000100:00100000:1.0:1788845826.321227:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c702359 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:7444:x1875740702283008:12345-0@lo:101: Request processed in 369us (2305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.321233:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788845826.321291:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283008:0@lo:101: 00010000:00010000:2.0:1788845826.321305:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000068910367/0x21b4d56138271557 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827155e expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.321313:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000068910367/0x21b4d56138271557 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827155e expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845826.321328:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788845826.321340:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000068910367/0x21b4d56138271557 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827155e expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.321346:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000068910367/0x21b4d56138271557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827155e expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845826.321358:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90e47518c000 10000000:01000000:2.0:1788845826.321363:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788845826.321367:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90e47518c000 from 1 10000000:01000000:2.0:1788845826.321385:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788845826.321408:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000050bb8374/0x21b4d56138271565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.321414:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000050bb8374/0x21b4d56138271565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.321422:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000050bb8374/0x21b4d56138271565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.321448:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283264:0@lo:101: 00000100:00100000:2.0:1788845826.321478:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.321503:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4522a50 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.321582:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702283264 00000100:00100000:1.0:1788845826.321591:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702283264 00000100:00100000:1.0:1788845826.321630:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845826.321638:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001eb82f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:7444:x1875740702283264:12345-0@lo:101: 00010000:00010000:1.0:1788845826.321646:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845826.321654:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019ba5e6d/0x21b4d5613827156c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271565 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.321669:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019ba5e6d/0x21b4d5613827156c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271565 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.321677:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019ba5e6d/0x21b4d5613827156c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271565 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.321683:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019ba5e6d, rc 0) 00000100:00100000:1.0:1788845826.321715:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001eb82f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:7444:x1875740702283264:12345-0@lo:101: Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.321731:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788845826.321748:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283264:0@lo:101: 00010000:00010000:2.0:1788845826.321761:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000050bb8374/0x21b4d56138271565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.321769:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000050bb8374/0x21b4d56138271565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845826.321779:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788845826.321793:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000050bb8374/0x21b4d56138271565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.321799:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000050bb8374/0x21b4d56138271565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845826.321804:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788845826.321807:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845826.321811:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90e47518c000 10000000:01000000:2.0:1788845826.321819:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788845826.321822:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788845826.321824:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788845826.321838:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000008103b13b/0x21b4d56138271573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.321844:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000008103b13b/0x21b4d56138271573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.321851:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000008103b13b/0x21b4d56138271573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.321860:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283392:0@lo:101: 00000100:00100000:2.0:1788845826.321884:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.321911:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4522a50 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.322056:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702283392 00000100:00100000:1.0:1788845826.322061:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702283392 00000100:00100000:1.0:1788845826.322093:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845826.322100:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033fb0b05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:7444:x1875740702283392:12345-0@lo:101: 00010000:00010000:1.0:1788845826.322107:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845826.322114:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006008da53/0x21b4d5613827157a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271573 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.322136:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006008da53/0x21b4d5613827157a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271573 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.322143:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006008da53/0x21b4d5613827157a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271573 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.322156:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006008da53, rc 0) 00000100:00100000:1.0:1788845826.322195:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033fb0b05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283392:12345-0@lo:101: Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.322201:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788845826.322300:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283392:0@lo:101: 00010000:00010000:2.0:1788845826.322311:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000008103b13b/0x21b4d56138271573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.322318:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000008103b13b/0x21b4d56138271573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.322412:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283520:0@lo:501: 00000100:00100000:2.0:1788845826.322437:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.323240:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4522a50 going to sleep for 11 seconds 00000100:00100000:0.0:1788845826.324368:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702283520 00000100:00100000:0.0:1788845826.324388:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702283520 00000100:00100000:1.0:1788845826.324655:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845826.324663:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be63a962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283520:12345-0@lo:501: 00000100:00100000:1.0:1788845826.324861:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be63a962 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283520:12345-0@lo:501: Request processed in 198us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.324869:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788845826.327199:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e5aa12ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283520:0@lo:501: 00000100:00100000:1.0:1788845826.327367:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d8c29ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283648:0@lo:503: 00000100:00100000:1.0:1788845826.327536:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.327627:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702283648 00000100:00100000:1.0:1788845826.327631:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba4de7c1 going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.327635:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702283648 00000100:00100000:3.0:1788845826.327691:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788845826.327699:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0271452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283648:12345-0@lo:503: 00000100:00100000:3.0:1788845826.328104:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0271452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283648:12345-0@lo:503: Request processed in 405us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.328113:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788845826.328190:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d8c29ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283648:0@lo:503: 00000040:00080000:1.0:1788845826.328503:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788845826.328605:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d8c29ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283776:0@lo:502: 00000100:00100000:1.0:1788845826.328650:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.328789:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba4de7c1 going to sleep for 11 seconds 00000100:00100000:2.0:1788845826.329021:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702283776 00000100:00100000:2.0:1788845826.329027:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702283776 00000100:00100000:3.0:1788845826.329177:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845826.329185:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009bb0ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283776:12345-0@lo:502: 00000100:00100000:3.0:1788845826.329281:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009bb0ca6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283776:12345-0@lo:502: Request processed in 98us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.329289:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845826.329371:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d8c29ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283776:0@lo:502: 00000040:00080000:2.0:1788845826.329626:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788845826.329659:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788845826.329672:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788845826.329684:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788845826.329696:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788845826.329708:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788845826.329730:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788845826.329744:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788845826.329756:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788845826.329769:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788845826.329784:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788845826.329796:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788845826.329806:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788845826.329817:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788845826.329828:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788845826.329850:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788845826.329865:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788845826.329877:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788845826.329890:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788845826.329902:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788845826.329915:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788845826.329926:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788845826.329937:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788845826.330084:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075c73803 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283904:0@lo:502: 00000100:00100000:2.0:1788845826.330131:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.330163:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010510345 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.330280:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702283904 00000100:00100000:1.0:1788845826.330358:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702283904 00000100:00100000:1.0:1788845826.330411:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788845826.330419:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058e8ee60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283904:12345-0@lo:502: 00000100:00100000:1.0:1788845826.330554:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058e8ee60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702283904:12345-0@lo:502: Request processed in 136us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.330562:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788845826.330623:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075c73803 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702283904:0@lo:502: 00000040:00080000:2.0:1788845826.330667:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788845826.330675:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788845826.331407:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845826.331419:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845826.331421:0:7457:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788845826.331436:0:7457:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788845826.331439:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788845826.331515:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000c6906a79) 00000020:00000080:2.0:1788845826.331557:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788845826.331565:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788845826.331652:0:7457:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788845826.331659:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d56138271588 00000020:00000080:2.0:1788845826.332060:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788845826.332065:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845826.332069:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845826.332071:0:7457:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788845826.332073:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845826.332077:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845826.332078:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788845826.332081:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788845826.332088:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000000600a607) 00000020:00000080:2.0:1788845826.332100:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788845826.332104:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788845826.332105:0:7457:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788845826.332108:0:7457:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788845826.332113:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788845826.332165:0:7457:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b8799553 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788845826.332177:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a11331a1) 00000020:00000080:2.0:1788845826.332185:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788845826.332239:0:7457:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788845826.332245:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d5613827159d 00000020:00000080:2.0:1788845826.332331:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788845826.332632:0:7457:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788845826.332639:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x21b4d561382715a4 00080000:01000000:2.0:1788845826.332644:0:7457:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788845826.332646:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d561382715ab 00080000:10000000:2.0:1788845826.333044:0:7457:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788845826.333226:0:7457:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788845826.438015:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788845826.438281:0:7457:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788845826.442628:0:7457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788845826.443026:0:7457:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788845826.458425:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788845826.458449:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845826.458457:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845826.458459:0:7457:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788845826.458463:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845826.458469:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845826.458471:0:7457:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788845826.458474:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788845826.458479:0:7457:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:0.0:1788845826.458506:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788845826.458632:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000517b921d) 00000020:00000080:0.0:1788845826.458657:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788845826.458664:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788845826.458782:0:7457:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788845826.458789:0:7457:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788845826.458799:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d561382715b9 00010000:00080000:0.0:1788845826.458834:0:7457:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006f6dc1ce@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788845826.463371:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1788845826.472080:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788845826.472098:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788845826.472142:0:7457:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788845826.472165:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382715c0 00000100:00080000:0.0:1788845826.472175:0:7457:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845826.472180:0:7457:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000006f6dc1ce using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788845826.472215:0:7457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000003c24569 x1875740702284032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788845826.472252:0:7457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788845826.472309:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003c24569 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702284032:0@lo:38: 00000100:00100000:0.0:1788845826.472328:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f8b4ea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702284160:0@lo:400: 00000100:00100000:2.0:1788845826.472681:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.473423:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702284032 00000100:00100000:1.0:1788845826.473433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702284032 00000100:00100000:1.0:1788845826.473473:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845826.473480:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075c73803 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702284032:12345-0@lo:38: 00010000:00080000:1.0:1788845826.473504:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1788845826.473553:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382715c7 00000004:00100000:1.0:1788845826.473568:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788845826.473573:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1788845826.474839:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845826.474845:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845826.474847:0:7457:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788845826.474851:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788845826.474854:0:7457:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788845826.474855:0:7457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788845826.474856:0:7457:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788845826.474858:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788845826.474860:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845826.474861:0:7457:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788845826.474863:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845826.474867:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845826.474868:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788845826.474871:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788845826.474915:0:7457:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788845826.474930:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845826.474932:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845826.474933:0:7457:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788845826.474935:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845826.474937:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845826.474938:0:7457:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788845826.474940:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788845826.474942:0:7457:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788845826.474974:0:7457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845826.474991:0:7457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845826.474992:0:7457:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845826.474995:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1788845826.475322:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788845826.475338:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788845826.475405:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788845826.475423:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000008103b13b/0x21b4d56138271573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.475435:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000008103b13b/0x21b4d56138271573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845826.475459:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702284160 00000100:00100000:1.0:1788845826.475466:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702284160 10000000:01000000:3.0:1788845826.475469:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e47518c000 from 1 10000000:01000000:3.0:1788845826.475473:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:1.0:1788845826.475509:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788845826.475516:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845826.475542:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078ad45b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702284160:12345-0@lo:400: 00010000:00010000:3.0:1788845826.475556:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.475571:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845826.475591:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097a9a4f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284288:0@lo:101: 00000100:00100000:1.0:1788845826.475621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078ad45b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702284160:12345-0@lo:400: Request processed in 104us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.475637:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.475668:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702284288 00000100:00100000:3.0:1788845826.475672:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702284288 00000100:00100000:3.0:1788845826.475702:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845826.475710:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9ac763c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+12:7444:x1875740702284288:12345-0@lo:101: 00010000:00010000:3.0:1788845826.475718:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788845826.475728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788845826.475730:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382715ce expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.475753:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382715ce expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.475776:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382715ce expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.475785:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b2c21f6, rc 0) 00000100:00100000:2.0:1788845826.475800:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e6fc9547 going to sleep for 11 seconds 00000100:00100000:2.0:1788845826.475827:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097a9a4f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284288:0@lo:101: 00010000:00010000:2.0:1788845826.475840:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.475851:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.476563:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9852451 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284416:0@lo:256: 00000100:00100000:3.0:1788845826.480779:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9ac763c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:7444:x1875740702284288:12345-0@lo:101: Request processed in 5062us (5134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.480794:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788845826.480960:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003f8b4ea8 x1875740702284160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845826.480976:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f8b4ea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702284160:0@lo:400: 00000100:00100000:2.0:1788845826.481257:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.481326:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702284416 00000100:00100000:1.0:1788845826.481335:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702284416 00000100:00100000:1.0:1788845826.481383:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788845826.481391:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c6a35cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:7444:x1875740702284416:12345-0@lo:256: 20000000:01000000:1.0:1788845826.481413:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788845826.481429:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788845826.481433:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788845826.481543:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c6a35cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:7444:x1875740702284416:12345-0@lo:256: Request processed in 131us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.481551:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788845826.481648:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075d2bb6f going to sleep for 11 seconds 00000100:00100000:2.0:1788845826.481666:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9852451 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284416:0@lo:256: 10000000:01000000:2.0:1788845826.482345:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788845826.482369:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.482389:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845826.482398:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47518c000 from 1 10000000:01000000:2.0:1788845826.482400:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845826.482427:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.482432:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.483116:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.483141:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c9852451 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284544:0@lo:101: 00000100:00100000:2.0:1788845826.483196:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.483228:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 0000000075d2bb6f going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.485667:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702284544 00000100:00100000:3.0:1788845826.485679:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702284544 00000100:00100000:3.0:1788845826.485725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845826.485732:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a904b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:7444:x1875740702284544:12345-0@lo:101: 00010000:00010000:3.0:1788845826.485746:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845826.485760:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382715dc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.485783:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382715dc expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.485792:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382715dc expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.485810:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f13a7c75, rc 0) 00000100:00080000:2.0:1788845826.486445:0:6520:0:(import.c:65:import_set_state_nolock()) 000000007faa2f64 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845826.486629:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075c73803 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702284032:12345-0@lo:38: Request processed in 13147us (13948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845826.486654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845826.486895:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845826.486905:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788845826.486912:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788845826.486917:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788845826.486920:0:3639:0:(import.c:65:import_set_state_nolock()) 000000006f6dc1ce lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788845826.486973:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003c24569 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702284032:0@lo:38: 00000100:00100000:3.0:1788845826.487022:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a904b12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:7444:x1875740702284544:12345-0@lo:101: Request processed in 1289us (3825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.487031:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788845826.487105:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014634e9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702284672:0@lo:41: 00000100:00100000:0.0:1788845826.487153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.489483:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702284672 00000100:00100000:3.0:1788845826.489499:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702284672 00000100:00100000:3.0:1788845826.489598:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845826.489613:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003c24569 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875740702284672:12345-0@lo:41: 00000004:00000024:2.0:1788845826.490142:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788845826.490234:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003c24569 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1875740702284672:12345-0@lo:41: Request processed in 622us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845826.490242:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845826.490357:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014634e9b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702284672:0@lo:41: 00000100:00100000:1.0:1788845826.491457:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c9852451 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284544:0@lo:101: 00010000:00010000:1.0:1788845826.491481:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.491503:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845826.491635:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001da4a7a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284800:0@lo:501: 00000100:00100000:1.0:1788845826.491700:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.491797:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010510345 going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.492104:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702284800 00000100:00100000:3.0:1788845826.492112:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702284800 00000100:00100000:2.0:1788845826.492265:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788845826.492273:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a873dec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:7444:x1875740702284800:12345-0@lo:501: 00000100:00100000:2.0:1788845826.492414:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a873dec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:7444:x1875740702284800:12345-0@lo:501: Request processed in 142us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845826.492421:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788845826.492498:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001da4a7a6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284800:0@lo:501: 00000100:00100000:3.0:1788845826.492552:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284928:0@lo:503: 00000100:00100000:3.0:1788845826.492594:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.492905:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 000000008bfdd504 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.492990:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702284928 00000100:00100000:1.0:1788845826.492996:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702284928 00000100:00100000:1.0:1788845826.493021:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788845826.493027:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e43ec311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:7444:x1875740702284928:12345-0@lo:503: 00000040:00080000:1.0:1788845826.493061:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788845826.493159:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e43ec311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:7444:x1875740702284928:12345-0@lo:503: Request processed in 131us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.493167:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845826.493267:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702284928:0@lo:503: 00000040:00080000:2.0:1788845826.493855:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845826.493914:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788845826.493993:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845826.495030:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788845826.495169:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788845826.495198:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845826.495254:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.495282:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845826.495328:0:7444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788845826.495331:0:7444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e47518c000 10000000:01000000:2.0:1788845826.495333:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e47518c000 10000000:01000000:2.0:1788845826.495337:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845826.495351:0:7444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e47518c000 from 1 10000000:01000000:2.0:1788845826.495354:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845826.495394:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000095b7bdc/0x21b4d561382715ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.495401:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000095b7bdc/0x21b4d561382715ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845826.495410:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000095b7bdc/0x21b4d561382715ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845826.495429:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8fa5480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285056:0@lo:101: 00000100:00100000:2.0:1788845826.495499:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.495559:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1b99c6d going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.495782:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702285056 00000100:00100000:1.0:1788845826.495790:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702285056 00000100:00100000:1.0:1788845826.495831:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788845826.495838:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000213a2dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:7444:x1875740702285056:12345-0@lo:101: 00010000:00010000:1.0:1788845826.495849:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845826.495859:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3b64c17/0x21b4d561382715f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382715ea expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.495878:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3b64c17/0x21b4d561382715f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382715ea expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.495886:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3b64c17/0x21b4d561382715f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382715ea expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.495893:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3b64c17, rc 0) 00000100:00100000:1.0:1788845826.495930:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000213a2dd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285056:12345-0@lo:101: Request processed in 92us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.495936:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845826.496051:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8fa5480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285056:0@lo:101: 00010000:00010000:3.0:1788845826.496065:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000095b7bdc/0x21b4d561382715ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845826.496073:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000095b7bdc/0x21b4d561382715ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845826.496156:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285184:0@lo:501: 00000100:00100000:3.0:1788845826.496184:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.496211:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd1c9631 going to sleep for 11 seconds 00000100:00100000:2.0:1788845826.496333:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702285184 00000100:00100000:2.0:1788845826.496338:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702285184 00000100:00100000:2.0:1788845826.496411:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788845826.496419:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8f59e22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285184:12345-0@lo:501: 00000100:00100000:2.0:1788845826.496549:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8f59e22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285184:12345-0@lo:501: Request processed in 132us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845826.496556:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845826.496627:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285184:0@lo:501: 00000100:00100000:3.0:1788845826.496664:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285312:0@lo:503: 00000100:00100000:3.0:1788845826.496698:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.497072:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd1c9631 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.497130:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702285312 00000100:00100000:1.0:1788845826.497140:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702285312 00000100:00100000:1.0:1788845826.497161:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788845826.497166:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000308f909e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285312:12345-0@lo:503: 00000100:00100000:1.0:1788845826.497247:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000308f909e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285312:12345-0@lo:503: Request processed in 81us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.497254:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788845826.497321:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285312:0@lo:503: 00000040:00080000:3.0:1788845826.497737:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845826.497810:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285440:0@lo:502: 00000100:00100000:3.0:1788845826.497846:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.497873:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd1c9631 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.497923:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702285440 00000100:00100000:1.0:1788845826.497927:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702285440 00000100:00100000:1.0:1788845826.497946:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788845826.497950:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ae263e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285440:12345-0@lo:502: 00000100:00100000:1.0:1788845826.498026:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ae263e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285440:12345-0@lo:502: Request processed in 75us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.498032:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788845826.498098:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285440:0@lo:502: 00000040:00080000:3.0:1788845826.498266:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788845826.498288:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788845826.498300:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788845826.498310:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788845826.498320:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788845826.498331:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788845826.498421:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788845826.498441:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788845826.498454:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788845826.498465:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788845826.498478:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788845826.498598:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788845826.498613:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788845826.498624:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788845826.498635:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788845826.498658:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788845826.498669:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788845826.498679:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788845826.498689:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788845826.498700:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788845826.498710:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788845826.498720:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788845826.498731:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788845826.498741:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788845826.498752:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788845826.498762:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788845826.498772:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788845826.498790:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788845826.498814:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285568:0@lo:502: 00000100:00100000:3.0:1788845826.498857:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.498917:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd1c9631 going to sleep for 11 seconds 00000100:00100000:2.0:1788845826.499009:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702285568 00000100:00100000:2.0:1788845826.499015:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702285568 00000100:00100000:1.0:1788845826.499053:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788845826.499060:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285568:12345-0@lo:502: 00000100:00100000:1.0:1788845826.499142:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036b38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285568:12345-0@lo:502: Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845826.499149:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788845826.499224:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285568:0@lo:502: 00000040:00080000:3.0:1788845826.499265:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788845826.499273:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788845826.499918:0:7463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788845826.499931:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000001130e33c) 00000020:00000080:3.0:1788845826.499949:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788845826.500026:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b8799553 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788845826.500029:0:7463:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b8799553 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788845826.500031:0:7463:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b8799553 3 00010000:00080000:3.0:1788845826.500060:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000026b558f2@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1788845826.502246:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788845826.502935:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788845826.502976:0:7463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788845826.502987:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x21b4d561382715ff 00000100:00080000:3.0:1788845826.502997:0:7463:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845826.503002:0:7463:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000026b558f2 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788845826.503033:0:7463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000045ed3e13 x1875740702285696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788845826.503095:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702285696:0@lo:38: 00000100:00100000:0.0:1788845826.503161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788845826.503219:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788845826.503662:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702285696 00000100:00100000:2.0:1788845826.503670:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702285696 00000100:00100000:2.0:1788845826.503701:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845826.503706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f8b4ea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702285696:12345-0@lo:38: 00010000:00080000:2.0:1788845826.503729:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1788845826.503764:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x21b4d56138271606 00000004:00100000:2.0:1788845826.503778:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788845826.503805:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000fe2d3f3f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845826.506313:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f8b4ea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875740702285696:12345-0@lo:38: Request processed in 2598us (3144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845826.506337:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788845826.508768:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788845826.509505:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788845826.509560:0:7444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788845826.509583:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000095b7bdc/0x21b4d561382715ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.509594:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000095b7bdc/0x21b4d561382715ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788845826.509646:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788845826.509648:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788845826.509653:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845826.509654:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845826.509655:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845826.509656:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845826.509657:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788845826.509659:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788845826.509660:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788845826.509661:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845826.509662:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788845826.509667:0:7444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788845826.509669:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788845826.509670:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788845826.509671:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845826.509672:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845826.509673:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845826.509674:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845826.509675:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788845826.509675:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788845826.509676:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788845826.509677:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845826.509678:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788845826.509702:0:7444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788845826.509719:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285824:0@lo:253: 00000100:00100000:1.0:1788845826.509801:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.509836:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097ecd9c0 going to sleep for 11 seconds 40000000:00080000:1.0:1788845826.509884:0:7464:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00010000:00080000:0.0:1788845826.510014:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000045ed3e13 x1875740702285696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845826.510026:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845826.510034:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788845826.510041:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788845826.510045:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788845826.510048:0:3639:0:(import.c:65:import_set_state_nolock()) 0000000026b558f2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788845826.510054:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045ed3e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702285696:0@lo:38: 00000100:00100000:0.0:1788845826.510088:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702285824 00000100:00100000:0.0:1788845826.510094:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702285824 00000100:00100000:0.0:1788845826.510178:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845826.510193:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4bd7659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7444:x1875740702285824:12345-0@lo:253: 20000000:01000000:0.0:1788845826.510219:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788845826.510232:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788845826.515509:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788845826.515571:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788845826.515583:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788845826.515669:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788845826.515674:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788845826.515694:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.515713:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271526 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.515719:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382715ce expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.515725:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.515762:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382715ce expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.515790:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382715ce expref: 15 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845826.515802:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702285952:0@lo:104: 00000100:00100000:0.0:1788845826.515865:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845826.515908:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271526 expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.515927:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271526 expref: 15 pid: 6508 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845826.515935:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee340405 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702286080:0@lo:104: 00000100:00100000:0.0:1788845826.515957:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845826.515973:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b7fd617 going to sleep for 11 seconds 00000100:00100000:0.0:1788845826.516059:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702285952 00000100:00100000:0.0:1788845826.516066:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702285952 00000100:00100000:0.0:1788845826.516101:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702286080 00000100:00100000:0.0:1788845826.516104:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702286080 00000100:00100000:0.0:1788845826.516122:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845826.516129:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d5cd3bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6531:x1875740702285952:12345-0@lo:104: 00010000:00010000:0.0:1788845826.516141:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516190:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845826.516195:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d5cd3bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6531:x1875740702285952:12345-0@lo:104: Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845826.516202:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845826.516217:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845826.516222:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b7a822d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6531:x1875740702286080:12345-0@lo:104: 00010000:00010000:0.0:1788845826.516228:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516266:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788845826.516271:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b7a822d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6531:x1875740702286080:12345-0@lo:104: Request processed in 50us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845826.516287:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845826.516321:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702285952:0@lo:104: 00000100:00100000:0.0:1788845826.516329:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee340405 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702286080:0@lo:104: 00010000:00010000:0.0:1788845826.516352:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516368:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788845826.516382:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516390:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bae22217 already unused, calling callback (00000000bd0b84b2) 10000000:00010000:0.0:1788845826.516393:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516400:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845826.516406:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845826.516411:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845826.516435:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516442:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845826.516460:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516467:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000bae22217/0x21b4d561382715ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715d5 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516485:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845826.516487:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516492:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be1326ca already unused, calling callback (00000000bd0b84b2) 10000000:00010000:0.0:1788845826.516493:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516498:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845826.516504:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845826.516508:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845826.516546:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516552:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845826.516563:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516569:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 00000000be1326ca/0x21b4d56138271526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827152d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516580:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845826.516581:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845826.516583:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845826.516593:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee340405 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702286208:0@lo:103: 00000100:00100000:0.0:1788845826.516628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845826.516658:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702286336:0@lo:103: 00000100:00100000:0.0:1788845826.516683:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845826.516727:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702286208 00000100:00100000:0.0:1788845826.516734:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702286208 00010000:00010000:0.0:1788845826.516752:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382715ce expref: 16 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845826.516770:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702286336 00000100:00100000:0.0:1788845826.516773:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702286336 00010000:00010000:0.0:1788845826.516781:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271526 expref: 17 pid: 6508 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845826.516792:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788845826.516794:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845826.516797:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abc324ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:3641:x1875740702286208:12345-0@lo:103: 00010000:00010000:0.0:1788845826.516806:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845826.516810:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382715ce expref: 17 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516819:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382715ce expref: 17 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516831:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b2c21f6/0x21b4d561382715d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382715ce expref: 17 pid: 6511 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516841:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845826.516865:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abc324ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:3641:x1875740702286208:12345-0@lo:103: Request processed in 69us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845826.516872:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845826.516884:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845826.516898:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f98bee76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:3642:x1875740702286336:12345-0@lo:103: 00010000:00010000:0.0:1788845826.516905:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845826.516908:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271526 expref: 15 pid: 6508 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516915:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271526 expref: 15 pid: 6508 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516924:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000000927c35/0x21b4d5613827152d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271526 expref: 15 pid: 6508 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516933:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516939:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788845826.516950:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007076048s 00010000:00010000:0.0:1788845826.516953:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516960:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516966:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516971:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516976:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000edd8c2a1 already unused, calling callback (00000000d91ca842) 00010000:00010000:0.0:1788845826.516984:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.516992:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.517015:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845826.517024:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845826.517051:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f98bee76 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:3642:x1875740702286336:12345-0@lo:103: Request processed in 154us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845826.517057:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845826.517110:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee340405 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702286208:0@lo:103: 00000100:00100000:0.0:1788845826.517128:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702286336:0@lo:103: 00010000:00010000:1.0:1788845826.517606:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.517616:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845826.517621:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000edd8c2a1/0x21b4d5613827160d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845826.517921:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4bd7659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:7444:x1875740702285824:12345-0@lo:253: Request processed in 7728us (8119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845826.517930:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788845826.518266:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7444:1875740702285824:0@lo:253: 10000000:01000000:1.0:1788845826.518286:0:7444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788845826.518289:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788845826.518290:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788845826.518291:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845826.518292:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845826.518293:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845826.518294:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845826.518296:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788845826.518297:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788845826.518298:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788845826.518299:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845826.518299:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788845826.518310:0:7444:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788845826.528195:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788845826.528415:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788845826.528668:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788845826.528856:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788845826.529061:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788845826.529207:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788845826.543361:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788845826.544221:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788845826.544781:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788845826.544972:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788845826.545157:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788845826.546045:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788845826.548361:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788845826.548977:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1788845826.549030:0:7469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000784d018f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875740702286464:0@lo:700: 00000100:00100000:3.0:1788845826.549096:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845826.549147:0:7469:0:(client.c:2715:ptlrpc_set_wait()) set 0000000059db4d76 going to sleep for 11 seconds 00000100:00100000:2.0:1788845826.549216:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702286464 00000100:00100000:2.0:1788845826.549224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702286464 00000100:00100000:2.0:1788845826.549265:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845826.549272:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000207e418e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1875740702286464:12345-0@lo:700: 00000040:01000000:0.0:1788845826.549509:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788845826.550103:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702286592:0@lo:1000: 00000100:00100000:2.0:1788845826.550148:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.550187:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000add1dc8b going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.550233:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702286592 00000100:00100000:3.0:1788845826.550238:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702286592 00000100:00100000:3.0:1788845826.550278:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845826.550285:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000914a781e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702286592:12345-0@lo:1000: 00000100:00100000:3.0:1788845826.550382:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000914a781e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702286592:12345-0@lo:1000: Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.550390:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845826.550462:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702286592:0@lo:1000: 00000040:01000000:2.0:1788845826.550669:0:7470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788845826.550698:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702286720:0@lo:700: 00000100:00100000:2.0:1788845826.550736:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.550759:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e142dbba going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.550807:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702286720 00000100:00100000:3.0:1788845826.550811:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702286720 00000100:00100000:3.0:1788845826.550844:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845826.550851:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffd13df3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702286720:12345-0@lo:700: 00000100:00100000:3.0:1788845826.550890:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffd13df3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702286720:12345-0@lo:700: Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.550896:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788845826.551342:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788845826.551464:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788845826.552445:0:7444:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788845826.552458:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:2.0:1788845826.552852:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702286720:0@lo:700: 00000100:00100000:2.0:1788845826.552920:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875740702286848:0@lo:900: 00000100:00100000:2.0:1788845826.552989:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.553027:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e142dbba going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.553093:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702286848 00000100:00100000:3.0:1788845826.553100:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702286848 00000100:00100000:3.0:1788845826.553147:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788845826.553155:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eff62dee pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1875740702286848:12345-0@lo:900: 00000100:00100000:3.0:1788845826.553204:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eff62dee pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1875740702286848:12345-0@lo:900: Request processed in 50us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.553211:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788845826.553277:0:7470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004e964df4 x1875740702286848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788845842 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845826.553288:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875740702286848:0@lo:900: 00000100:00100000:2.0:1788845826.553349:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702286976:0@lo:1000: 00000100:00100000:2.0:1788845826.553387:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.553409:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1b99c6d going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.553451:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702286976 00000100:00100000:3.0:1788845826.553456:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702286976 00000100:00100000:3.0:1788845826.553500:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845826.553507:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7033ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702286976:12345-0@lo:1000: 00000100:00100000:3.0:1788845826.553622:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7033ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702286976:12345-0@lo:1000: Request processed in 116us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.553628:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1788845826.554154:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845826.554660:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702286976:0@lo:1000: 00000004:00080000:2.0:1788845826.554714:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000e142dbba with version 0 00000020:00100000:2.0:1788845826.554736:0:7470:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788845826.554742:0:7470:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004e964df4 x1875740702287232/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788845826.554758:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702287232:0@lo:1000: 00000100:00100000:2.0:1788845826.554802:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845826.554823:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f14a1af3 going to sleep for 11 seconds 00000020:00080000:1.0:1788845826.555531:0:7468:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788845826.555537:0:7468:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788845826.558482:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702287232 00000100:00100000:3.0:1788845826.558497:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702287232 00000100:00100000:3.0:1788845826.558575:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845826.558584:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9ca503b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702287232:12345-0@lo:1000: 00000040:00080000:0.0:1788845826.562066:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000001:00080000:1.0:1788845826.562835:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:2.0:1788845826.562962:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1788845826.564819:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9ca503b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702287232:12345-0@lo:1000: Request processed in 6230us (10009us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788845826.564835:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788845826.564851:0:7470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788845826.564857:0:7470:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788845826.564873:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702287232:0@lo:1000: 00000100:00100000:1.0:1788845826.564967:0:7470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702287360:0@lo:1000: 00000100:00100000:1.0:1788845826.565002:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845826.565037:0:7470:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042af0035 going to sleep for 11 seconds 00000100:00100000:3.0:1788845826.565121:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702287360 00000100:00100000:3.0:1788845826.565128:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702287360 00000100:00100000:3.0:1788845826.565169:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845826.565177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e2ce295 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702287360:12345-0@lo:1000: 00000100:00100000:3.0:1788845826.565993:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e2ce295 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875740702287360:12345-0@lo:1000: Request processed in 815us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845826.566002:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845826.566052:0:7470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875740702287360:0@lo:1000: 00000040:00080000:3.0:1788845826.566119:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788845826.566151:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000b5afcf10 with version 1 00000040:00080000:0.0:1788845826.567404:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788845826.567467:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788845826.567718:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788845826.567939:0:7444:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788845826.568630:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788845826.568791:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788845826.568929:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000004:00080000:1.0:1788845826.570590:0:7460:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000353aa438 version 1 rpc_version 1 00000020:00100000:1.0:1788845826.570635:0:7460:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788845826.570645:0:7460:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000de49e58f x1875740702287616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788845826.570681:0:7460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1875740702287616:0@lo:1000: 00000100:00100000:1.0:1788845826.570768:0:7460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:0.0:1788845826.570785:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:1.0:1788845826.570811:0:7460:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042af0035 going to sleep for 11 seconds 00000100:00100000:1.0:1788845826.570830:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702287616 00000100:00100000:1.0:1788845826.570838:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702287616 00000100:00100000:1.0:1788845826.570890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1788845826.570897:0:7470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1788845826.570899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b47afc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7460:x1875740702287616:12345-0@lo:1000: 00000004:00080000:3.0:1788845826.570963:0:7470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:0.0:1788845826.571237:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788845826.571470:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788845826.571659:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788845826.573962:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788845826.574241:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000100:00100000:2.0:1788845826.577149:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000207e418e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1875740702286464:12345-0@lo:700: Request processed in 27871us (28046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845826.577166:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788845826.577224:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000784d018f x1875740702286464/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788845842 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845826.577254:0:7469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000784d018f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875740702286464:0@lo:700: 40000000:02000000:3.0:1788845826.577267:0:7469:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1788845826.577672:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788845826.577979:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788845826.578122:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788845826.579196:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788845826.579354:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788845826.579503:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788845826.579664:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788845826.579980:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000001:00080000:1.0:1788845826.581028:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788845826.581155:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b47afc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7460:x1875740702287616:12345-0@lo:1000: Request processed in 10254us (10385us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788845826.581168:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788845826.581225:0:7460:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788845826.581230:0:7460:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788845826.581246:0:7460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7460:1875740702287616:0@lo:1000: 00100000:10000000:0.0:1788845826.585303:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788845826.590087:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788845826.590313:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788845826.590466:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788845826.592498:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000040:00080000:0.0:1788845826.598775:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788845826.598893:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788845826.599042:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788845826.599966:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788845826.602772:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788845826.603216:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788845826.603450:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788845826.603660:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788845826.603816:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788845826.604869:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788845826.605447:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788845826.605684:0:7444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788845826.607505:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788845826.607809:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788845826.607815:0:7469:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1788845826.618564:0:7444:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788845826.618606:0:7444:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb1f081a23988 00100000:10000000:2.0:1788845826.618624:0:7444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788845826.619172:0:7444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788845826.619205:0:7444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788845826.619226:0:7444:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788845826.619242:0:7444:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788845826.620176:0:7444:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788845826.620380:0:7444:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788845826.874013:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845827.897708:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788845828.670503:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788845828.670511:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e47518c000 from 4 10000000:01000000:1.0:1788845828.670516:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788845828.670592:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 00000000e8f214b2/0x21b4d56138271614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.670612:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 00000000e8f214b2/0x21b4d56138271614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.670623:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 00000000e8f214b2/0x21b4d56138271614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845828.670644:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702287744:0@lo:101: 00000100:00100000:1.0:1788845828.671933:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.671997:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3138e1e going to sleep for 11 seconds 00000100:00100000:2.0:1788845828.672085:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702287744 00000100:00100000:2.0:1788845828.672095:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702287744 00000100:00100000:2.0:1788845828.672179:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788845828.672187:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000480772c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:6513:x1875740702287744:12345-0@lo:101: 00010000:00010000:2.0:1788845828.672201:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845828.672218:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cebc0db1/0x21b4d5613827161b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271614 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845828.672251:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cebc0db1/0x21b4d5613827161b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271614 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845828.672262:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cebc0db1/0x21b4d5613827161b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271614 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845828.672270:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cebc0db1, rc 0) 00000100:00100000:2.0:1788845828.672322:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000480772c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:6513:x1875740702287744:12345-0@lo:101: Request processed in 136us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845828.672329:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788845828.672417:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702287744:0@lo:101: 00010000:00010000:0.0:1788845828.672433:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 00000000e8f214b2/0x21b4d56138271614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.672442:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 00000000e8f214b2/0x21b4d56138271614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845828.672503:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702287872:0@lo:256: 00000100:00100000:0.0:1788845828.672571:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.672606:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca05efe6 going to sleep for 11 seconds 00000100:00100000:2.0:1788845828.672639:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702287872 00000100:00100000:2.0:1788845828.672644:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702287872 00000100:00100000:2.0:1788845828.672689:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788845828.672697:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d44d443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:6513:x1875740702287872:12345-0@lo:256: 20000000:01000000:2.0:1788845828.672712:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788845828.672732:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788845828.672735:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788845828.672841:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d44d443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:6513:x1875740702287872:12345-0@lo:256: Request processed in 146us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845828.672848:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788845828.672935:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702287872:0@lo:256: 10000000:01000000:0.0:1788845828.672978:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788845828.672984:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 00000000e8f214b2/0x21b4d56138271614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.672992:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 00000000e8f214b2/0x21b4d56138271614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845828.673002:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788845828.673004:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e451417000 from 21 10000000:01000000:0.0:1788845828.673006:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845828.673024:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000008005b0fb/0x21b4d56138271622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.673031:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000008005b0fb/0x21b4d56138271622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.673039:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000008005b0fb/0x21b4d56138271622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845828.673056:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288000:0@lo:101: 00000100:00100000:0.0:1788845828.673080:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.673103:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca05efe6 going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.673118:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702288000 00000100:00100000:1.0:1788845828.673124:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702288000 00000100:00100000:1.0:1788845828.673155:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788845828.673161:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087b4d99d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:6513:x1875740702288000:12345-0@lo:101: 00010000:00010000:1.0:1788845828.673169:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845828.673179:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef31a833/0x21b4d56138271629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271622 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.673194:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef31a833/0x21b4d56138271629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271622 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.673202:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef31a833/0x21b4d56138271629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271622 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.673208:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef31a833, rc 0) 00000100:00100000:1.0:1788845828.673252:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087b4d99d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702288000:12345-0@lo:101: Request processed in 91us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.673259:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788845828.673398:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288000:0@lo:101: 00010000:00010000:0.0:1788845828.673408:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000008005b0fb/0x21b4d56138271622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.673416:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000008005b0fb/0x21b4d56138271622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845828.673464:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288128:0@lo:501: 00000100:00100000:0.0:1788845828.673489:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.673513:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca05efe6 going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.674197:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702288128 00000100:00100000:1.0:1788845828.674209:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702288128 00000100:00100000:1.0:1788845828.674954:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788845828.674967:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003eb4bda9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702288128:12345-0@lo:501: 00000100:00100000:1.0:1788845828.675120:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003eb4bda9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702288128:12345-0@lo:501: Request processed in 157us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.675127:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788845828.678701:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288128:0@lo:501: 00000100:00100000:0.0:1788845828.678757:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288256:0@lo:503: 00000100:00100000:0.0:1788845828.678823:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.678937:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca05efe6 going to sleep for 11 seconds 00000100:00100000:2.0:1788845828.679018:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702288256 00000100:00100000:2.0:1788845828.679027:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702288256 00000100:00100000:2.0:1788845828.679075:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845828.679083:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000435a84d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702288256:12345-0@lo:503: 00000100:00100000:2.0:1788845828.679274:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000435a84d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702288256:12345-0@lo:503: Request processed in 191us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845828.679282:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788845828.679307:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288256:0@lo:503: 00000100:00100000:2.0:1788845828.680065:0:7603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff7b99ca pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7603:1875740702288384:0@lo:502: 00000100:00100000:2.0:1788845828.680293:0:7603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845828.680333:0:7603:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a6d0e38 going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.680496:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702288384 00000100:00100000:1.0:1788845828.680504:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702288384 00000100:00100000:1.0:1788845828.680563:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788845828.680571:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdb7af97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7603:x1875740702288384:12345-0@lo:502: 00000100:00100000:1.0:1788845828.680688:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdb7af97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7603:x1875740702288384:12345-0@lo:502: Request processed in 118us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.680697:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788845828.680758:0:7603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff7b99ca pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7603:1875740702288384:0@lo:502: 00000100:00100000:1.0:1788845828.680805:0:7603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033645d8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7603:1875740702288512:0@lo:502: 00000100:00100000:1.0:1788845828.680840:0:7603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.680941:0:7603:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069244295 going to sleep for 11 seconds 00000100:00100000:0.0:1788845828.681010:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702288512 00000100:00100000:0.0:1788845828.681015:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702288512 00000100:00100000:0.0:1788845828.681054:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788845828.681182:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db9e1719 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7603:x1875740702288512:12345-0@lo:502: 00000100:00100000:0.0:1788845828.681252:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db9e1719 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:7603:x1875740702288512:12345-0@lo:502: Request processed in 73us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845828.681268:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788845828.681351:0:7603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033645d8a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7603:1875740702288512:0@lo:502: 00000040:00080000:1.0:1788845828.681381:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788845828.681697:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788845828.681716:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845828.681723:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000008005b0fb/0x21b4d56138271622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.681733:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000008005b0fb/0x21b4d56138271622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845828.681742:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788845828.681744:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e451417000 from 4 10000000:01000000:0.0:1788845828.681746:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788845828.681770:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 000000008b61600d/0x21b4d56138271630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.681777:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 000000008b61600d/0x21b4d56138271630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.681784:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 000000008b61600d/0x21b4d56138271630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845828.681796:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288640:0@lo:101: 00000100:00100000:0.0:1788845828.681826:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.681935:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702288640 00000100:00100000:1.0:1788845828.681940:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702288640 00000100:00100000:1.0:1788845828.684453:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788845828.684468:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c25e46c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702288640:12345-0@lo:101: 00010000:00010000:1.0:1788845828.684483:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845828.684500:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004758c2cc/0x21b4d56138271637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271630 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.684555:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004758c2cc/0x21b4d56138271637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271630 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.684566:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004758c2cc/0x21b4d56138271637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271630 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.684575:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004758c2cc, rc 0) 00000100:00100000:1.0:1788845828.684645:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c25e46c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702288640:12345-0@lo:101: Request processed in 183us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.684652:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788845828.685195:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c78e4d14 going to sleep for 11 seconds 00000100:00100000:0.0:1788845828.685226:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288640:0@lo:101: 00010000:00010000:0.0:1788845828.685243:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 000000008b61600d/0x21b4d56138271630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.685253:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 000000008b61600d/0x21b4d56138271630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845828.685318:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288768:0@lo:256: 00000100:00100000:0.0:1788845828.685373:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.685449:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c78e4d14 going to sleep for 11 seconds 00000100:00100000:2.0:1788845828.691268:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702288768 00000100:00100000:2.0:1788845828.691284:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702288768 00000100:00100000:2.0:1788845828.691350:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788845828.691369:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008edd238b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702288768:12345-0@lo:256: 20000000:01000000:2.0:1788845828.691396:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788845828.691412:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788845828.691416:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788845828.691572:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008edd238b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702288768:12345-0@lo:256: Request processed in 214us (6200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845828.691581:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788845828.691695:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288768:0@lo:256: 10000000:01000000:0.0:1788845828.691754:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788845828.691762:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 000000008b61600d/0x21b4d56138271630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.691772:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 000000008b61600d/0x21b4d56138271630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845828.691780:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788845828.691783:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788845828.691786:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845828.691814:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000026f03923/0x21b4d5613827163e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.691821:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000026f03923/0x21b4d5613827163e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845828.691829:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000026f03923/0x21b4d5613827163e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845828.691856:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288896:0@lo:101: 00000100:00100000:0.0:1788845828.691892:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.691929:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c78e4d14 going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.693024:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702288896 00000100:00100000:1.0:1788845828.693033:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702288896 00000100:00100000:1.0:1788845828.693184:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845828.693192:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045ea29b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702288896:12345-0@lo:101: 00010000:00010000:1.0:1788845828.693206:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845828.693219:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7efe1cb/0x21b4d56138271645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827163e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.693243:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7efe1cb/0x21b4d56138271645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827163e expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.693253:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7efe1cb/0x21b4d56138271645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827163e expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.693261:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7efe1cb, rc 0) 00000100:00100000:1.0:1788845828.693313:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045ea29b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702288896:12345-0@lo:101: Request processed in 123us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.693320:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845828.693384:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702288896:0@lo:101: 00010000:00010000:1.0:1788845828.693398:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000026f03923/0x21b4d5613827163e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.693406:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000026f03923/0x21b4d5613827163e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845828.693465:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033645d8a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702289024:0@lo:501: 00000100:00100000:1.0:1788845828.693495:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.693547:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000881700f9 going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.693559:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702289024 00000100:00100000:1.0:1788845828.693563:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702289024 00000100:00100000:1.0:1788845828.693584:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788845828.693589:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da436b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702289024:12345-0@lo:501: 00000100:00100000:1.0:1788845828.693688:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da436b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702289024:12345-0@lo:501: Request processed in 99us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.693695:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788845828.693725:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033645d8a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702289024:0@lo:501: 00000100:00100000:1.0:1788845828.693750:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033645d8a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702289152:0@lo:503: 00000100:00100000:1.0:1788845828.693786:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.693802:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000881700f9 going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.693812:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702289152 00000100:00100000:1.0:1788845828.693816:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702289152 00000100:00100000:1.0:1788845828.693834:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788845828.693838:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dac45e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702289152:12345-0@lo:503: 00000100:00100000:1.0:1788845828.694252:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dac45e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702289152:12345-0@lo:503: Request processed in 413us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.694268:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788845828.700311:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033645d8a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702289152:0@lo:503: 00000100:00100000:1.0:1788845828.703733:0:7605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7605:1875740702289280:0@lo:502: 00000100:00100000:1.0:1788845828.703812:0:7605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.703860:0:7605:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cd576253 going to sleep for 11 seconds 00000100:00100000:0.0:1788845828.703985:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702289280 00000100:00100000:0.0:1788845828.703993:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702289280 00000100:00100000:0.0:1788845828.704067:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788845828.704075:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e4f0bd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:7605:x1875740702289280:12345-0@lo:502: 00000100:00100000:0.0:1788845828.704218:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e4f0bd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:7605:x1875740702289280:12345-0@lo:502: Request processed in 143us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845828.704226:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845828.704878:0:7605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7605:1875740702289280:0@lo:502: 00000020:01000000:1.0:1788845828.704988:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845828.705000:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845828.705003:0:7605:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788845828.705008:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788845828.705012:0:7605:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:1.0:1788845828.705038:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788845828.705052:0:7605:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000001106a27b) 00000020:00000080:1.0:1788845828.705072:0:7605:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788845828.705081:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788845828.705272:0:7605:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788845828.705278:0:7605:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788845828.705295:0:7605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138271653 00010000:00080000:1.0:1788845828.705328:0:7605:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cc83dae0@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1788845828.707805:0:7605:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788845828.709197:0:7605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788845828.709212:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788845828.709242:0:7605:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788845828.709262:0:7605:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d5613827165a 00000100:00080000:1.0:1788845828.709273:0:7605:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788845828.709278:0:7605:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000cc83dae0 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788845828.709309:0:7605:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000034db77ee x1875740702289408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788845828.709337:0:7605:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788845828.709541:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702289408:0@lo:38: 00000100:00100000:2.0:1788845828.709621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788845828.709827:0:7605:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1788845828.710247:0:7611:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000de49e58f x1875740702289920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845828.710257:0:7611:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010f7d038 going to sleep for 0 seconds 00000020:01000000:2.0:1788845828.710339:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845828.710343:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845828.710349:0:7605:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788845828.710354:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845828.710366:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845828.710376:0:7605:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788845828.710380:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788845828.710381:0:7605:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788845828.710401:0:7605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7605:1875740702290048:0@lo:502: 00000100:00100000:2.0:1788845828.710448:0:7605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845828.710488:0:7605:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1b99c6d going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.710648:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702290048 00000100:00100000:1.0:1788845828.710656:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702290048 00000100:00100000:1.0:1788845828.710731:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845828.710740:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006960b37e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:7605:x1875740702290048:12345-0@lo:502: 00000100:00100000:1.0:1788845828.710915:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006960b37e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:7605:x1875740702290048:12345-0@lo:502: Request processed in 176us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.710922:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788845828.710982:0:7605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:7605:1875740702290048:0@lo:502: 00000020:01000000:2.0:1788845828.711008:0:7605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845828.711013:0:7605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845828.711015:0:7605:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788845828.711018:0:7605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788845828.711570:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788845828.711600:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788845828.711608:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000026f03923/0x21b4d5613827163e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845828.711619:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000026f03923/0x21b4d5613827163e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845828.711633:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788845828.711635:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90e450c6cd28 from 1 10000000:01000000:2.0:1788845828.711638:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788845828.711664:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000077403de2/0x21b4d56138271661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845828.711671:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000077403de2/0x21b4d56138271661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845828.711687:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000077403de2/0x21b4d56138271661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845828.711692:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051ab0101 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702289536:0@lo:400: 00000100:00100000:2.0:1788845828.711703:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702290176:0@lo:101: 00000100:00100000:2.0:1788845828.711743:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845828.711769:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1b99c6d going to sleep for 11 seconds 00000100:00100000:2.0:1788845828.711786:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702289408 00000100:00100000:2.0:1788845828.711790:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702289408 00000100:00100000:2.0:1788845828.711809:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845828.711814:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff7b99ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702289408:12345-0@lo:38: 00010000:00080000:2.0:1788845828.711833:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:2.0:1788845828.711863:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138271668 00000004:00100000:2.0:1788845828.711875:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788845828.711880:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788845828.711978:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.711986:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702290176 00000100:00100000:1.0:1788845828.711991:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702290176 00000100:00100000:1.0:1788845828.712025:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788845828.712031:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fe6d43c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702290176:12345-0@lo:101: 00010000:00010000:1.0:1788845828.712040:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845828.712051:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a24d407/0x21b4d5613827166f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271661 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.712071:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a24d407/0x21b4d5613827166f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271661 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.712081:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a24d407/0x21b4d5613827166f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271661 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.712090:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a24d407, rc 0) 00000100:00100000:0.0:1788845828.712099:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003710a8d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702289664:0@lo:400: 00000100:00100000:0.0:1788845828.712135:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.712160:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845828.712166:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033645d8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702289792:0@lo:400: 00000100:00100000:0.0:1788845828.712187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.712216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702289536 00000100:00100000:0.0:1788845828.712219:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702289536 00000100:00100000:0.0:1788845828.712244:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702289792 00000100:00100000:0.0:1788845828.712247:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702289792 00000100:00100000:0.0:1788845828.712259:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845828.712265:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee340405 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702289536:12345-0@lo:400: 00000100:00100000:0.0:1788845828.712299:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee340405 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702289536:12345-0@lo:400: Request processed in 34us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845828.712306:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845828.712319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845828.712324:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008346a7ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702289792:12345-0@lo:400: 00000100:00100000:0.0:1788845828.712352:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008346a7ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702289792:12345-0@lo:400: Request processed in 28us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845828.712376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788845828.712407:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000051ab0101 x1875740702289536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845828.712419:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051ab0101 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702289536:0@lo:400: 00010000:00080000:0.0:1788845828.712439:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000033645d8a x1875740702289792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845828.712446:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033645d8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702289792:0@lo:400: 00000100:00100000:1.0:1788845828.712468:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fe6d43c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702290176:12345-0@lo:101: Request processed in 436us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.712475:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788845828.712506:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788845828.712582:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788845828.712718:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e964df4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702290176:0@lo:101: 00010000:00010000:1.0:1788845828.712733:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000077403de2/0x21b4d56138271661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.712742:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000077403de2/0x21b4d56138271661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845828.712797:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702290304:0@lo:501: 00000100:00100000:1.0:1788845828.712824:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.712843:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005c68a4e going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.712855:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702290304 00000100:00100000:1.0:1788845828.712859:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702290304 00000100:00100000:1.0:1788845828.712883:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788845828.712889:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c44dea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702290304:12345-0@lo:501: 00000100:00100000:1.0:1788845828.712957:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c44dea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702290304:12345-0@lo:501: Request processed in 68us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788845828.712964:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788845828.712995:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702290304:0@lo:501: 10000000:01000000:1.0:1788845828.713018:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788845828.713022:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: 0000000077403de2/0x21b4d56138271661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845828.713029:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: 0000000077403de2/0x21b4d56138271661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845828.716095:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702289664 00000100:00100000:0.0:1788845828.716108:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702289664 00000100:00100000:2.0:1788845828.716510:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788845828.716536:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004305bbac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702289664:12345-0@lo:400: 00000100:00100000:2.0:1788845828.716627:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004305bbac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702289664:12345-0@lo:400: Request processed in 109us (4492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845828.716635:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845828.716741:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003710a8d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702289664:0@lo:400: 00000100:00080000:3.0:1788845828.724429:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000a00897d2 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845828.724546:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff7b99ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702289408:12345-0@lo:38: Request processed in 12729us (14924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845828.724557:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845828.724570:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845828.724579:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788845828.724587:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788845828.724592:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788845828.724594:0:3639:0:(import.c:65:import_set_state_nolock()) 00000000cc83dae0 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788845828.724611:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000010f7d038): req@00000000de49e58f x1875740702289920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845828.724625:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702289408:0@lo:38: 00000100:00100000:1.0:1788845828.725079:0:7611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.725120:0:7611:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010f7d038 going to sleep for 11 seconds 00000100:00100000:0.0:1788845828.725121:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702290432:0@lo:41: 00000100:00100000:0.0:1788845828.725159:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845828.725262:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702289920 00000100:00100000:0.0:1788845828.725268:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702289920 00000100:00100000:0.0:1788845828.725306:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702290432 00000100:00100000:0.0:1788845828.725309:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702290432 00000100:00100000:0.0:1788845828.725325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845828.725340:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ab1e689 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7611:x1875740702289920:12345-0@lo:1000: 00000100:00100000:3.0:1788845828.725386:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788845828.725394:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abc324ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875740702290432:12345-0@lo:41: 00000100:00100000:0.0:1788845828.725435:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ab1e689 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7611:x1875740702289920:12345-0@lo:1000: Request processed in 96us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845828.725443:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00000024:3.0:1788845828.725547:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788845828.725591:0:7611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702289920:0@lo:1000: 00000100:00100000:3.0:1788845828.725592:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abc324ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702290432:12345-0@lo:41: Request processed in 197us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845828.725604:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:01000000:1.0:1788845828.725634:0:7611:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788845828.725680:0:7611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702290560:0@lo:1000: 00000100:00100000:1.0:1788845828.725711:0:7611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.725733:0:7611:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a76bf52 going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.725747:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702290560 00000100:00100000:1.0:1788845828.725750:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702290560 00000100:00100000:1.0:1788845828.725774:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845828.725781:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001da4a7a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7611:x1875740702290560:12345-0@lo:1000: 00000100:00100000:1.0:1788845828.725896:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001da4a7a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7611:x1875740702290560:12345-0@lo:1000: Request processed in 116us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845828.725902:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845828.725926:0:7611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702290560:0@lo:1000: 00000100:00100000:1.0:1788845828.725960:0:7611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702290688:0@lo:700: 00000100:00100000:1.0:1788845828.725988:0:7611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.726010:0:7611:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005c68a4e going to sleep for 11 seconds 00000100:00100000:3.0:1788845828.726028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702290688 00000100:00100000:3.0:1788845828.726034:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702290688 00000100:00100000:3.0:1788845828.726065:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845828.726072:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d8c29ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7611:x1875740702290688:12345-0@lo:700: 00000100:00100000:3.0:1788845828.726135:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d8c29ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7611:x1875740702290688:12345-0@lo:700: Request processed in 64us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845828.726143:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845828.726160:0:7611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702290688:0@lo:700: 00000100:00100000:1.0:1788845828.726258:0:7611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702290816:0@lo:1000: 00000100:00100000:1.0:1788845828.726287:0:7611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.726312:0:7611:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ed572fb going to sleep for 11 seconds 00000100:00100000:3.0:1788845828.726563:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702290816 00000100:00100000:3.0:1788845828.726568:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702290816 00000100:00100000:3.0:1788845828.726608:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845828.726616:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019d869f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7611:x1875740702290816:12345-0@lo:1000: 00000100:00100000:3.0:1788845828.726674:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019d869f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7611:x1875740702290816:12345-0@lo:1000: Request processed in 61us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845828.726691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788845828.726737:0:7611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702290816:0@lo:1000: 00000004:00080000:1.0:1788845828.726778:0:7611:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000005c68a4e with version 0 00000020:00100000:1.0:1788845828.726794:0:7611:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788845828.726801:0:7611:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000de49e58f x1875740702291072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788845828.726827:0:7611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702291072:0@lo:1000: 00000100:00100000:1.0:1788845828.726855:0:7611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.726875:0:7611:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0449ea6 going to sleep for 11 seconds 00000100:00100000:1.0:1788845828.726888:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702291072 00000100:00100000:1.0:1788845828.726892:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702291072 00000100:00100000:1.0:1788845828.726910:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788845828.726917:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdee7bbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7611:x1875740702291072:12345-0@lo:1000: 00000100:00100000:0.0:1788845828.727727:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702290432:0@lo:41: 00000001:00080000:1.0:1788845828.741387:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788845828.741404:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788845828.741720:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdee7bbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7611:x1875740702291072:12345-0@lo:1000: Request processed in 14801us (14861us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788845828.741805:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1788845828.742034:0:7611:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788845828.742039:0:7611:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788845828.742054:0:7611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702291072:0@lo:1000: 00000100:00100000:1.0:1788845828.742140:0:7611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702291200:0@lo:1000: 00000100:00100000:1.0:1788845828.742180:0:7611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845828.742228:0:7611:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a76bf52 going to sleep for 11 seconds 00000100:00100000:3.0:1788845828.743411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702291200 00000100:00100000:3.0:1788845828.743424:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702291200 00000100:00100000:3.0:1788845828.743477:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788845828.743486:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061575257 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7611:x1875740702291200:12345-0@lo:1000: 00000100:00100000:3.0:1788845828.743618:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061575257 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7611:x1875740702291200:12345-0@lo:1000: Request processed in 134us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845828.743625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845828.744102:0:7611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7611:1875740702291200:0@lo:1000: 00000040:00080000:2.0:1788845828.744129:0:7611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788845828.744171:0:7611:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000211833c6 with version 1 00000004:00080000:3.0:1788845828.744954:0:7609:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000025d5db75 version 1 rpc_version 1 00000020:00100000:3.0:1788845828.745052:0:7609:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788845828.745061:0:7609:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000784d018f x1875740702291456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788845828.745083:0:7609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000784d018f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7609:1875740702291456:0@lo:1000: 00000100:00100000:3.0:1788845828.745143:0:7609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845828.745198:0:7609:0:(client.c:2715:ptlrpc_set_wait()) set 000000001b33f31f going to sleep for 11 seconds 00000100:00100000:0.0:1788845828.745254:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702291456 00000100:00100000:0.0:1788845828.745261:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702291456 00000100:00100000:0.0:1788845828.745303:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788845828.745310:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007882215 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7609:x1875740702291456:12345-0@lo:1000: 00000001:00080000:1.0:1788845828.748481:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1788845828.750272:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007882215 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7609:x1875740702291456:12345-0@lo:1000: Request processed in 4954us (5122us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788845828.750287:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788845828.751673:0:7609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788845828.751681:0:7609:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788845828.751710:0:7609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000784d018f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7609:1875740702291456:0@lo:1000: 00000040:00080000:2.0:1788845828.754263:0:7611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788845828.754338:0:7611:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788845828.754343:0:7611:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788845828.923566:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845829.945698:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788845830.277061:0:7721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788845830.970420:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788845831.129874:0:7773:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788845831.130074:0:7773:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788845831.996905:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845831.997217:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845831.997238:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b3884d2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702291584:0@lo:41: 00000100:00100000:2.0:1788845831.997342:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845831.997401:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702291584 00000100:00100000:2.0:1788845831.997408:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702291584 00000100:00100000:2.0:1788845831.997447:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845831.997454:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002334548b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702291584:12345-0@lo:41: 00000004:00000024:2.0:1788845831.997485:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788845831.997539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002334548b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702291584:12345-0@lo:41: Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845831.997545:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845831.997585:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b3884d2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702291584:0@lo:41: 00010000:00010000:0.0:1788845833.019054:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788845834.019786:0:7874:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788845834.020034:0:7874:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788845834.041719:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702291840:0@lo:400: 00000100:00100000:1.0:1788845834.041867:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702291968:0@lo:400: 00000100:00100000:0.0:1788845834.041870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845834.041897:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845834.041922:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845834.041922:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788845834.041927:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702292096:0@lo:400: 00000100:00100000:0.0:1788845834.041927:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008a248345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702291712:0@lo:400: 00000100:00100000:0.0:1788845834.041954:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845834.041959:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845834.041973:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003710a8d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702292224:0@lo:400: 00010000:00010000:1.0:1788845834.041985:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845834.041993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845834.041996:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702291712 00000100:00100000:1.0:1788845834.042002:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702291712 00000100:00100000:1.0:1788845834.042044:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788845834.042052:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b45d5b30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3641:x1875740702291712:12345-0@lo:400: 00000100:00100000:1.0:1788845834.042093:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b45d5b30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3641:x1875740702291712:12345-0@lo:400: Request processed in 43us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845834.042100:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788845834.042134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702291840 00000100:00100000:1.0:1788845834.042137:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702291840 00000100:00100000:1.0:1788845834.042159:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702292096 00000100:00100000:1.0:1788845834.042162:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702292096 00000100:00100000:0.0:1788845834.042167:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008a248345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702291712:0@lo:400: 00000100:00100000:1.0:1788845834.042174:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788845834.042178:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000718dcc3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702291840:12345-0@lo:400: 00000100:00100000:0.0:1788845834.042205:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845834.042208:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000718dcc3b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702291840:12345-0@lo:400: Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845834.042212:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702292352:0@lo:41: 00000100:00100000:0.0:1788845834.042246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845834.042268:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788845834.042276:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788845834.042289:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702291968 00000100:00100000:0.0:1788845834.042292:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702291968 00000100:00100000:0.0:1788845834.042311:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702292224 00000100:00100000:0.0:1788845834.042314:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702292224 00000100:00100000:0.0:1788845834.042336:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702292352 00000100:00100000:0.0:1788845834.042339:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702292352 00000100:00100000:0.0:1788845834.042349:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845834.042354:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033645d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702291968:12345-0@lo:400: 00000100:00100000:0.0:1788845834.042390:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033645d8a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702291968:12345-0@lo:400: Request processed in 36us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845834.042396:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788845834.042408:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845834.042413:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfbd5736 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702292224:12345-0@lo:400: 00000100:00100000:0.0:1788845834.042442:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfbd5736 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702292224:12345-0@lo:400: Request processed in 29us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845834.042448:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788845834.042457:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788845834.042624:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6c8acbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702292352:12345-0@lo:41: 00000004:00000024:0.0:1788845834.042647:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788845834.042873:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6c8acbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702292352:12345-0@lo:41: Request processed in 251us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845834.042881:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788845834.042915:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4d3e2a4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702292352:0@lo:41: 00000100:00100000:0.0:1788845834.042938:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003710a8d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702292224:0@lo:400: 00010000:00080000:0.0:1788845834.042959:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000de49e58f x1875740702291840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845834.042970:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de49e58f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702291840:0@lo:400: 00000100:00100000:0.0:1788845834.043004:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788845834.043012:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845834.043018:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051ab0101 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702292096:12345-0@lo:400: 00000100:00100000:0.0:1788845834.043048:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051ab0101 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702292096:12345-0@lo:400: Request processed in 31us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845834.043054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788845834.043090:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000034db77ee x1875740702292096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845834.043100:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702292096:0@lo:400: 00000100:00100000:0.0:1788845834.043108:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702291968:0@lo:400: 00000100:00100000:1.0:1788845834.043530:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788845835.065718:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788845835.135270:0:7923:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1514c7d0 20000000:00000080:1.0:1788845835.135289:0:7923:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e4751a4c00 uarg=0000000000000000 20000000:01000000:1.0:1788845835.135492:0:7923:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788845835.135499:0:7923:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788845835.135504:0:7923:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788845835.135695:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788845835.135708:0:7923:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788845835.144138:0:7923:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845835.144752:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788845835.144789:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788845835.144807:0:7923:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788845835.144835:0:7923:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788845835.144852:0:7923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.144870:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382714ee expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.144876:0:7923:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382715dc expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.144883:0:7923:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.144922:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382715dc expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.144934:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382715dc expref: 17 pid: 6509 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845835.144946:0:7923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1875740702292480:0@lo:104: 00000100:00100000:1.0:1788845835.145024:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845835.146834:0:7923:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382714ee expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.146852:0:7923:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382714ee expref: 17 pid: 6508 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845835.146865:0:7923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1875740702292608:0@lo:104: 00000100:00100000:1.0:1788845835.146903:0:7923:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a36d137e going to sleep for 11 seconds 00000100:00100000:0.0:1788845835.148424:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788845835.148464:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845835.148505:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702292480 00000100:00100000:0.0:1788845835.148514:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702292480 00000100:00100000:0.0:1788845835.149126:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702292608 00000100:00100000:0.0:1788845835.149132:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702292608 00000100:00100000:0.0:1788845835.149149:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845835.149157:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa06f9f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:7923:x1875740702292480:12345-0@lo:104: 00010000:00010000:0.0:1788845835.149279:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845835.149587:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845835.149593:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa06f9f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:7923:x1875740702292480:12345-0@lo:104: Request processed in 438us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845835.149614:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845835.149670:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788845835.149678:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4d3e2a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:7923:x1875740702292608:12345-0@lo:104: 00010000:00010000:0.0:1788845835.149685:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845835.149790:0:7923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1875740702292480:0@lo:104: 00000100:00100000:1.0:1788845835.149801:0:7923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7923:1875740702292608:0@lo:104: 00010000:00010000:1.0:1788845835.149829:0:7923:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845835.151970:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845835.151989:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845835.152002:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003def91c0 already unused, calling callback (00000000bd0b84b2) 10000000:00010000:3.0:1788845835.152004:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845835.152027:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845835.152034:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845835.152039:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845835.152625:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845835.152638:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4d3e2a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:7923:x1875740702292608:12345-0@lo:104: Request processed in 2958us (4172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845835.152647:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788845835.153112:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845835.153428:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788845835.153484:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788845835.153600:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845835.153608:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000003def91c0/0x21b4d561382715dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715e3 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845835.153623:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845835.153626:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845835.153631:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001bf44350 already unused, calling callback (00000000bd0b84b2) 10000000:00010000:2.0:1788845835.153645:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845835.153653:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845835.153658:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845835.153663:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845835.153681:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845835.153686:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845835.153789:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845835.153844:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8fa5480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702292864:0@lo:103: 00000100:00100000:3.0:1788845835.153909:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845835.153998:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b3884d2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702292736:0@lo:103: 00000100:00100000:3.0:1788845835.154020:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845835.154049:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845835.154056:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: 000000001bf44350/0x21b4d561382714ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382714f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845835.154069:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845835.154071:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845835.154072:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845835.154662:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702292864 00000100:00100000:0.0:1788845835.154672:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702292864 00010000:00010000:0.0:1788845835.154702:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382714ee expref: 18 pid: 6508 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845835.155093:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702292736 00000100:00100000:1.0:1788845835.155098:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702292736 00010000:00010000:1.0:1788845835.155115:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382715dc expref: 19 pid: 6509 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845835.155145:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845835.155153:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000214ecda5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:3643:x1875740702292864:12345-0@lo:103: 00010000:00010000:1.0:1788845835.155174:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845835.155179:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382714ee expref: 19 pid: 6508 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155188:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382714ee expref: 19 pid: 6508 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155202:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1760620/0x21b4d561382714f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382714ee expref: 19 pid: 6508 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155215:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845835.155265:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000214ecda5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3643:x1875740702292864:12345-0@lo:103: Request processed in 114us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845835.155272:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845835.155482:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8fa5480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702292864:0@lo:103: 00000100:00100000:1.0:1788845835.155608:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788845835.155619:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066daa2b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:3643:x1875740702292736:12345-0@lo:103: 00010000:00010000:1.0:1788845835.155627:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845835.155631:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382715dc expref: 17 pid: 6509 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155652:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382715dc expref: 17 pid: 6509 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155661:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f13a7c75/0x21b4d561382715e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382715dc expref: 17 pid: 6509 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155672:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155678:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155692:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155699:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155704:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155709:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155714:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061a1ca27 already unused, calling callback (00000000d91ca842) 00010000:00010000:1.0:1788845835.155717:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155723:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155756:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845835.155766:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845835.155798:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066daa2b3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:3643:x1875740702292736:12345-0@lo:103: Request processed in 182us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845835.155804:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845835.155879:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b3884d2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702292736:0@lo:103: 00010000:00010000:3.0:1788845835.155902:0:7923:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845835.155909:0:7923:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845835.155915:0:7923:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061a1ca27/0x21b4d56138271676 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7923 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845836.097737:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845837.113910:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845837.114185:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845837.116375:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702292992:0@lo:41: 00000100:00100000:2.0:1788845837.116453:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.116662:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702292992 00000100:00100000:1.0:1788845837.116671:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702292992 00000100:00100000:1.0:1788845837.116729:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788845837.116737:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9852451 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702292992:12345-0@lo:41: 00000004:00000024:1.0:1788845837.116775:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788845837.116830:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9852451 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702292992:12345-0@lo:41: Request processed in 94us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.116836:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845837.116968:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034db77ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702292992:0@lo:41: 10000000:01000000:1.0:1788845837.645576:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845837.645583:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47518c000 from 1 10000000:01000000:1.0:1788845837.645587:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845837.645641:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: 0000000049199510/0x21b4d5613827167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.645653:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: 0000000049199510/0x21b4d5613827167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.645663:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: 0000000049199510/0x21b4d5613827167d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.645683:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293120:0@lo:101: 00000100:00100000:1.0:1788845837.645751:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.645783:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702293120 00000100:00100000:1.0:1788845837.645789:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702293120 00000100:00100000:1.0:1788845837.645830:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788845837.645837:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003262eb01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702293120:12345-0@lo:101: 00010000:00010000:1.0:1788845837.645849:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845837.645859:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000061a1ca27/0x21b4d56138271684 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827167d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.645877:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061a1ca27/0x21b4d56138271684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827167d expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.645887:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000061a1ca27/0x21b4d56138271684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827167d expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.645895:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000061a1ca27, rc 0) 00000100:00100000:1.0:1788845837.645920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003262eb01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702293120:12345-0@lo:101: Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.645926:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788845837.645968:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ed572fb going to sleep for 11 seconds 00000100:00100000:1.0:1788845837.645986:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293120:0@lo:101: 00010000:00010000:1.0:1788845837.645998:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: 0000000049199510/0x21b4d5613827167d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845837.646006:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: 0000000049199510/0x21b4d5613827167d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845837.646071:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293248:0@lo:501: 00000100:00100000:1.0:1788845837.646100:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.646112:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ed572fb going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.646425:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702293248 00000100:00100000:0.0:1788845837.646430:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702293248 00000100:00100000:0.0:1788845837.646462:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788845837.646467:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d53dddce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702293248:12345-0@lo:501: 00000100:00100000:0.0:1788845837.646591:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d53dddce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702293248:12345-0@lo:501: Request processed in 124us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.646597:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788845837.646900:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293248:0@lo:501: 00000100:00100000:1.0:1788845837.646927:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293376:0@lo:503: 00000100:00100000:1.0:1788845837.646965:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845837.646985:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702293376 00000100:00100000:1.0:1788845837.646989:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702293376 00000100:00100000:1.0:1788845837.647011:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788845837.647016:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b830baeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702293376:12345-0@lo:503: 00000100:00100000:1.0:1788845837.647807:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b830baeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702293376:12345-0@lo:503: Request processed in 789us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845837.647815:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788845837.647862:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ed572fb going to sleep for 11 seconds 00000100:00100000:1.0:1788845837.647877:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd6a1a63 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293376:0@lo:503: 00000100:00100000:3.0:1788845837.650117:0:8037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037a8945e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8037:1875740702293504:0@lo:502: 00000100:00100000:3.0:1788845837.650194:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.650242:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702293504 00000100:00100000:3.0:1788845837.650248:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702293504 00000100:00100000:3.0:1788845837.650287:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788845837.651755:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dbfd203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8037:x1875740702293504:12345-0@lo:502: 00000100:00100000:3.0:1788845837.651997:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dbfd203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8037:x1875740702293504:12345-0@lo:502: Request processed in 1701us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.652005:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788845837.652070:0:8037:0:(client.c:2715:ptlrpc_set_wait()) set 00000000085a0260 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.652091:0:8037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037a8945e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8037:1875740702293504:0@lo:502: 00000020:01000000:3.0:1788845837.652120:0:8037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845837.652130:0:8037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.652132:0:8037:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788845837.652139:0:8037:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e47518c000 00000020:00000080:3.0:1788845837.652141:0:8037:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845837.652185:0:8037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8037:1875740702293632:0@lo:502: 00000100:00100000:3.0:1788845837.652221:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.652253:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702293632 00000100:00100000:3.0:1788845837.652258:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702293632 00000100:00100000:3.0:1788845837.652288:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788845837.652306:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8037:x1875740702293632:12345-0@lo:502: 00000100:00100000:3.0:1788845837.652361:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8037:x1875740702293632:12345-0@lo:502: Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.652367:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788845837.652394:0:8037:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.652404:0:8037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8037:1875740702293632:0@lo:502: 00000020:01000000:3.0:1788845837.652420:0:8037:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845837.652423:0:8037:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.652429:0:8037:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788845837.652432:0:8037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788845837.652488:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788845837.652507:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845837.652516:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.652544:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845837.652554:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788845837.652556:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451417000 from 1 10000000:01000000:3.0:1788845837.652559:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845837.652580:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.652587:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.652596:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845837.652606:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293760:0@lo:101: 00000100:00100000:3.0:1788845837.653757:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.653803:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702293760 00000100:00100000:3.0:1788845837.653881:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702293760 00000100:00100000:3.0:1788845837.653920:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788845837.653927:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702293760:12345-0@lo:101: 00010000:00010000:3.0:1788845837.653940:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845837.653957:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827168b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.653992:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827168b expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.654003:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827168b expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.654012:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065000, rc 0) 00000100:00100000:3.0:1788845837.654047:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702293760:12345-0@lo:101: Request processed in 120us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.654052:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788845837.654090:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.654109:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293760:0@lo:101: 00010000:00010000:3.0:1788845837.654124:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.654132:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845837.654192:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293888:0@lo:501: 00000100:00100000:3.0:1788845837.654217:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.654244:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.654441:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702293888 00000100:00100000:0.0:1788845837.654446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702293888 00000100:00100000:0.0:1788845837.654477:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788845837.654484:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702293888:12345-0@lo:501: 00000100:00100000:0.0:1788845837.655017:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702293888:12345-0@lo:501: Request processed in 532us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.655028:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788845837.655079:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702293888:0@lo:501: 00000100:00100000:0.0:1788845837.655113:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702294016:0@lo:503: 00000100:00100000:0.0:1788845837.655150:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845837.655173:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702294016 00000100:00100000:0.0:1788845837.655177:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702294016 00000100:00100000:0.0:1788845837.655199:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788845837.655206:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702294016:12345-0@lo:503: 00000100:00100000:0.0:1788845837.655276:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702294016:12345-0@lo:503: Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.655283:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788845837.655329:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e445577480 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.655341:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702294016:0@lo:503: 00000100:00100000:3.0:1788845837.668199:0:8040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8040:1875740702294144:0@lo:502: 00000100:00100000:3.0:1788845837.668280:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845837.670784:0:8040:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845837.672598:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702294144 00000100:00100000:0.0:1788845837.672756:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702294144 00000100:00100000:0.0:1788845837.672942:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845837.672952:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8040:x1875740702294144:12345-0@lo:502: 00000100:00100000:0.0:1788845837.673165:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8040:x1875740702294144:12345-0@lo:502: Request processed in 214us (4884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845837.673173:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788845837.678798:0:8040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8040:1875740702294144:0@lo:502: 00000020:01000000:2.0:1788845837.685576:0:8040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845837.685591:0:8040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845837.685593:0:8040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788845837.685601:0:8040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e451417000 00000020:00000080:2.0:1788845837.685610:0:8040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845837.685663:0:8040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8040:1875740702294272:0@lo:502: 00000100:00100000:2.0:1788845837.685739:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845837.685776:0:8040:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450e57900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845837.686952:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702294272 00000100:00100000:3.0:1788845837.686970:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702294272 00000100:00100000:3.0:1788845837.687036:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788845837.687121:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8040:x1875740702294272:12345-0@lo:502: 00000100:00100000:3.0:1788845837.687260:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8040:x1875740702294272:12345-0@lo:502: Request processed in 216us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845837.687268:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788845837.687343:0:8040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8040:1875740702294272:0@lo:502: 00000020:01000000:3.0:1788845837.687374:0:8040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845837.687381:0:8040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845837.687383:0:8040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788845837.687387:0:8040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788845837.687558:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788845837.687581:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845837.687591:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845837.687601:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845838.137955:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845839.162340:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702294400:0@lo:400: 00000100:00100000:2.0:1788845839.162439:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845839.162550:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702294400 00000100:00100000:2.0:1788845839.162558:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702294400 00000100:00100000:2.0:1788845839.162616:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788845839.162627:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3641:x1875740702294400:12345-0@lo:400: 00000100:00100000:2.0:1788845839.162692:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3641:x1875740702294400:12345-0@lo:400: Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845839.162702:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788845839.162760:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702294400:0@lo:400: 00000100:00100000:3.0:1788845839.162964:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702294528:0@lo:400: 00000100:00100000:2.0:1788845839.163160:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702294784:0@lo:400: 00000100:00100000:3.0:1788845839.163202:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845839.163208:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702294912:0@lo:400: 00000100:00100000:3.0:1788845839.163294:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845839.163309:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702294656:0@lo:400: 00000100:00100000:3.0:1788845839.163363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845839.163412:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702294528 00000100:00100000:3.0:1788845839.163421:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702294528 00000100:00100000:2.0:1788845839.163430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845839.163492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845839.163548:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702294656 00000100:00100000:2.0:1788845839.163553:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702294656 00000100:00100000:2.0:1788845839.163583:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702294912 00000100:00100000:2.0:1788845839.163585:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702294912 00000100:00100000:2.0:1788845839.163599:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845839.163608:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702294656:12345-0@lo:400: 00000100:00100000:2.0:1788845839.163662:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702294656:12345-0@lo:400: Request processed in 56us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845839.163686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845839.163700:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788845839.163706:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702294912:12345-0@lo:400: 00000100:00100000:2.0:1788845839.163737:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702294912:12345-0@lo:400: Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845839.163742:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788845839.163936:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845839.163967:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702294912:0@lo:400: 00000100:00100000:1.0:1788845839.163999:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702294656:0@lo:400: 00000100:00100000:0.0:1788845839.164397:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845839.164414:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702295040:0@lo:41: 00000100:00100000:0.0:1788845839.164458:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845839.165085:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702294784 00000100:00100000:3.0:1788845839.165093:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702294784 00000100:00100000:2.0:1788845839.165126:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845839.165144:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702294528:12345-0@lo:400: 00000100:00100000:2.0:1788845839.165302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702294528:12345-0@lo:400: Request processed in 165us (2109us total) trans 0 rc 0/0 00010000:00080000:1.0:1788845839.165567:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4437a5500 x1875740702294528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845839.165583:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702294528:0@lo:400: 00000100:00100000:1.0:1788845839.165660:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702295040 00000100:00100000:1.0:1788845839.165666:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702295040 00000100:00100000:1.0:1788845839.165706:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788845839.165714:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702295040:12345-0@lo:41: 00000004:00000024:1.0:1788845839.165763:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788845839.166194:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702295040:12345-0@lo:41: Request processed in 473us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845839.166206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788845839.166234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845839.166258:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702294784:12345-0@lo:400: 00000100:00100000:1.0:1788845839.166282:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702295040:0@lo:41: 00000100:00100000:3.0:1788845839.166322:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702294784:12345-0@lo:400: Request processed in 68us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845839.166329:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788845839.166362:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4437a5c00 x1875740702294784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845839.166374:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702294784:0@lo:400: 00000100:00100000:2.0:1788845839.171340:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788845840.186021:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845841.209882:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845842.234255:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845842.236932:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702295168:0@lo:41: 00000100:00100000:3.0:1788845842.237003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845842.237089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702295168 00000100:00100000:3.0:1788845842.237097:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702295168 00000100:00100000:3.0:1788845842.237140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788845842.237150:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702295168:12345-0@lo:41: 00000004:00000024:3.0:1788845842.237182:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788845842.237237:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702295168:12345-0@lo:41: Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845842.237252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788845842.240499:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702295168:0@lo:41: 00010000:00010000:1.0:1788845843.257620:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845844.281708:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702295552:0@lo:400: 00000100:00100000:1.0:1788845844.281708:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702295424:0@lo:400: 00000100:00100000:0.0:1788845844.281764:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702295296:0@lo:400: 00000100:00100000:2.0:1788845844.283712:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702295680:0@lo:400: 00000100:00100000:1.0:1788845844.285156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.285245:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702295424 00000100:00100000:1.0:1788845844.285264:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702295424 00000100:00100000:1.0:1788845844.285422:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788845844.285433:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702295424:12345-0@lo:400: 00000100:00100000:1.0:1788845844.285491:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702295424:12345-0@lo:400: Request processed in 61us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.285499:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788845844.285607:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4437a6d80 x1875740702295424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845844.285621:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702295424:0@lo:400: 00000100:00100000:1.0:1788845844.285702:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702295936:0@lo:41: 00000100:00100000:1.0:1788845844.285735:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.285782:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702295936 00000100:00100000:1.0:1788845844.285787:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702295936 00000100:00100000:1.0:1788845844.285814:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788845844.285821:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702295936:12345-0@lo:41: 00000004:00000024:1.0:1788845844.285846:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788845844.285882:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702295936:12345-0@lo:41: Request processed in 62us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.285889:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788845844.286123:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702295936:0@lo:41: 00000100:00100000:3.0:1788845844.287352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845844.287358:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.287429:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702295552 00000100:00100000:1.0:1788845844.287436:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702295552 00000100:00100000:1.0:1788845844.287470:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845844.287478:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702295552:12345-0@lo:400: 00000100:00100000:1.0:1788845844.287563:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702295552:12345-0@lo:400: Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.287571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845844.287607:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702295296 00000100:00100000:1.0:1788845844.287612:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702295296 00000100:00100000:1.0:1788845844.287638:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788845844.287644:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3640:x1875740702295296:12345-0@lo:400: 00000100:00100000:1.0:1788845844.287673:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3640:x1875740702295296:12345-0@lo:400: Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.287679:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788845844.287911:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702295296:0@lo:400: 00000100:00100000:0.0:1788845844.288032:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702295808:0@lo:400: 00000100:00100000:0.0:1788845844.288062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.288236:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702295808 00000100:00100000:1.0:1788845844.288240:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702295808 00000100:00100000:1.0:1788845844.288278:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845844.288285:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702295808:12345-0@lo:400: 00000100:00100000:1.0:1788845844.288423:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702295808:12345-0@lo:400: Request processed in 139us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.288430:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845844.288486:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702295808:0@lo:400: 00000100:00100000:2.0:1788845844.288731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845844.288800:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845844.290633:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702295680 00000100:00100000:0.0:1788845844.290645:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702295680 00000100:00100000:0.0:1788845844.290701:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845844.290711:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702295680:12345-0@lo:400: 00000100:00100000:0.0:1788845844.290993:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702295680:12345-0@lo:400: Request processed in 283us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.291002:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845844.291049:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702295552:0@lo:400: 00010000:00080000:2.0:1788845844.291070:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4437a5f80 x1875740702295680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845844.291083:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702295680:0@lo:400: 00000020:01000004:0.0:1788845844.463911:0:8424:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788845844.463915:0:8424:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788845844.463916:0:8424:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788845844.464023:0:8424:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e451767800 00000020:01000004:0.0:1788845844.464038:0:8424:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788845844.464050:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788845844.464062:0:8424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90e46e1c3370) 00000020:00000080:0.0:1788845844.464082:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788845844.520595:0:8424:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788845844.520661:0:8424:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788845844.548497:0:8424:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788845844.548721:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788845844.548732:0:8424:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788845844.548742:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21b4d561382716a0 00000020:01000004:2.0:1788845844.548748:0:8424:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788845844.548768:0:8424:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788845844.548777:0:8424:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788845844.548783:0:8424:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788845844.548788:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788845844.548799:0:8424:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90e46d518000) 00000020:00000080:2.0:1788845844.548811:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788845844.550230:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845844.550403:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788845844.550408:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788845844.553298:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788845844.553310:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788845844.554356:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788845844.554365:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788845844.557002:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845844.557180:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788845844.557187:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788845844.558450:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788845844.558460:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788845844.577111:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845844.577355:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788845844.577361:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788845844.581148:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788845844.581162:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788845844.582352:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788845844.582363:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788845844.584446:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788845844.584689:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788845844.584695:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788845844.585497:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788845844.585504:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788845844.629013:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788845844.629216:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788845844.629223:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788845844.631871:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788845844.631890:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788845844.632986:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788845844.633019:0:8424:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788845844.633025:0:8424:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788845844.650083:0:8424:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788845844.650119:0:8424:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788845844.650123:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788845844.650125:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788845844.650126:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845844.650128:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845844.650129:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845844.650130:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845844.650131:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788845844.650133:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788845844.650134:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788845844.650135:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845844.650137:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788845844.650140:0:8424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788845844.650142:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788845844.650144:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788845844.650145:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845844.650146:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788845844.650147:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845844.650148:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845844.650149:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788845844.650150:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788845844.650151:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788845844.650152:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845844.650153:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788845844.650179:0:8424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788845844.650196:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702296064:0@lo:253: 00000100:00100000:1.0:1788845844.650283:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.650414:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.650514:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702296064 00000100:00100000:2.0:1788845844.650874:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702296064 00000100:00100000:2.0:1788845844.650962:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788845844.650973:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8424:x1875740702296064:12345-0@lo:253: 20000000:01000000:2.0:1788845844.651014:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788845844.651018:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788845844.651023:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788845844.651026:0:6508:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788845844.651290:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845844.651446:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788845844.651461:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788845844.651490:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788845844.651497:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788845844.651509:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788845844.651550:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788845844.651630:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788845844.651645:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1788845844.651647:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1788845844.651661:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788845844.651667:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788845844.651681:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788845844.651698:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1788845844.651725:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788845844.651734:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788845844.651747:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788845844.651771:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788845844.651840:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788845844.651851:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1788845844.651853:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1788845844.651866:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788845844.651871:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788845844.651883:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788845844.651889:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1788845844.651901:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788845844.651906:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788845844.651918:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788845844.651932:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788845844.652304:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788845844.652315:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1788845844.652324:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1788845844.652342:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788845844.652347:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788845844.652360:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788845844.652365:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1788845844.652377:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788845844.652382:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788845844.652396:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788845844.652412:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788845844.652424:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788845844.652427:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788845844.652431:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788845844.652474:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788845844.652477:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788845844.653413:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788845844.653449:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788845844.653481:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788845844.653915:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788845844.655037:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788845844.655066:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788845844.655080:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788845844.655083:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788845844.655493:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788845844.655890:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788845844.655914:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788845844.655929:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788845844.655942:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788845844.655944:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788845844.656224:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788845844.656261:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788845844.656292:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788845844.656426:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788845844.656445:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788845844.656460:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788845844.656467:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788845844.656468:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788845844.656964:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788845844.656985:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788845844.657000:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788845844.657145:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788845844.657164:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788845844.657178:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1788845844.657192:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788845844.657210:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657225:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e6000/0x21b4d5613827157a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271573 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657240:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e7000/0x21b4d561382715f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382715ea expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657259:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e6800/0x21b4d56138271629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271622 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657267:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827163e expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657274:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e6400/0x21b4d5613827166f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271661 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657281:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657319:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e6400/0x21b4d5613827166f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271661 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657334:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e6400/0x21b4d5613827166f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271661 expref: 18 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.657348:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296192:0@lo:104: 00000100:00100000:2.0:1788845844.657411:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845844.657511:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827163e expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.657664:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827163e expref: 18 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.657675:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296320:0@lo:104: 00000100:00100000:2.0:1788845844.657717:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845844.657993:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e6800/0x21b4d56138271629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271622 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.658003:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e6800/0x21b4d56138271629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271622 expref: 18 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.658012:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458336a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296448:0@lo:104: 00000100:00100000:2.0:1788845844.658046:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845844.658101:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702296192 00000100:00100000:0.0:1788845844.658108:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702296192 00000100:00100000:0.0:1788845844.658144:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702296320 00000100:00100000:0.0:1788845844.658146:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702296320 00000100:00100000:0.0:1788845844.658162:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845844.658170:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702296192:12345-0@lo:104: 00010000:00010000:0.0:1788845844.658182:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138271661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658258:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845844.658265:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702296192:12345-0@lo:104: Request processed in 96us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.658272:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845844.658289:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845844.658296:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702296320:12345-0@lo:104: 00010000:00010000:0.0:1788845844.658304:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e440031400/0x21b4d5613827163e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658338:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788845844.658343:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458336680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702296320:12345-0@lo:104: Request processed in 49us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.658350:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788845844.658378:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788845844.658385:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138271661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658393:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788845844.658398:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138271661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658406:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138271661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845844.658415:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138271661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845844.658420:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845844.658452:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138271661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658459:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845844.658480:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138271661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658486:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138271661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827166f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658497:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845844.658500:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e440031400/0x21b4d5613827163e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658506:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788845844.658509:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e440031400/0x21b4d5613827163e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658516:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e440031400/0x21b4d5613827163e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845844.658551:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e440031400/0x21b4d5613827163e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845844.658555:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788845844.658566:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e440031400/0x21b4d5613827163e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658571:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845844.658576:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e440031400/0x21b4d5613827163e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658592:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e440031400/0x21b4d5613827163e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271645 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658603:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845844.658604:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845844.658606:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845844.658624:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702296576:0@lo:103: 00000100:00100000:0.0:1788845844.658655:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845844.658684:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845844.658702:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702296704:0@lo:103: 00000100:00100000:0.0:1788845844.658722:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845844.658745:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702296576 00000100:00100000:0.0:1788845844.658749:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702296576 00010000:00010000:0.0:1788845844.658883:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e6400/0x21b4d5613827166f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271661 expref: 19 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845844.658903:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702296704 00000100:00100000:0.0:1788845844.658906:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702296704 00010000:00010000:0.0:1788845844.658918:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271645 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827163e expref: 20 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845844.658930:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845844.658936:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3642:x1875740702296576:12345-0@lo:103: 00010000:00010000:0.0:1788845844.658945:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845844.658950:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e6400/0x21b4d5613827166f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271661 expref: 20 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658959:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e6400/0x21b4d5613827166f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271661 expref: 20 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.658984:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845844.659012:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3642:x1875740702296576:12345-0@lo:103: Request processed in 76us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.659019:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788845844.659032:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845844.659038:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:3642:x1875740702296704:12345-0@lo:103: 00010000:00010000:0.0:1788845844.659045:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845844.659050:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271645 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827163e expref: 19 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.659058:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827163e expref: 19 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.659069:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845844.659089:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:3642:x1875740702296704:12345-0@lo:103: Request processed in 51us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.659095:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845844.659125:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702296704:0@lo:103: 00000100:00100000:0.0:1788845844.659133:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702296576:0@lo:103: 00010000:00010000:3.0:1788845844.659218:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845844.660413:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e7000/0x21b4d561382715f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382715ea expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.660427:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e7000/0x21b4d561382715f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382715ea expref: 18 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.660439:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296832:0@lo:104: 00000100:00100000:2.0:1788845844.660493:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845844.660511:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e6000/0x21b4d5613827157a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271573 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845844.660629:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702296448 00000100:00100000:0.0:1788845844.660636:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702296448 00000100:00100000:0.0:1788845844.660665:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702296832 00000100:00100000:0.0:1788845844.660668:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702296832 00000100:00100000:0.0:1788845844.660682:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845844.660824:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702296448:12345-0@lo:104: 00010000:00010000:0.0:1788845844.660838:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d56138271622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.660941:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e6000/0x21b4d5613827157a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271573 expref: 18 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.660953:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296960:0@lo:104: 00000100:00100000:2.0:1788845844.660988:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.661005:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685780 going to sleep for 11 seconds 00010000:00010000:2.0:1788845844.661024:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e6400/0x21b4d5613827166f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271661 expref: 18 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.661036:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296192:0@lo:104: 00010000:00010000:2.0:1788845844.661055:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827163e expref: 17 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.661062:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296320:0@lo:104: 00000100:00100000:2.0:1788845844.661068:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458336a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296448:0@lo:104: 00010000:00010000:0.0:1788845844.661099:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845844.661105:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702296448:12345-0@lo:104: Request processed in 350us (3059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.661111:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845844.661125:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702296960 00000100:00100000:0.0:1788845844.661128:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702296960 00000100:00100000:0.0:1788845844.661141:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788845844.661145:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702296832:12345-0@lo:104: 00010000:00010000:0.0:1788845844.661152:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e4820ee800/0x21b4d561382715ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.661222:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296832:0@lo:104: 00010000:00010000:3.0:1788845844.663718:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845844.663731:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d56138271622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.663743:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030c00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845844.663747:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d56138271622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.663757:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d56138271622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845844.663884:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d56138271622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845844.663889:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845844.663946:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d56138271622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.663952:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788845844.664026:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702297088:0@lo:103: 00000100:00100000:2.0:1788845844.664089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845844.664143:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d56138271622 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.664151:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e440030c00/0x21b4d56138271622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271629 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.664164:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845844.664167:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4820ee800/0x21b4d561382715ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.664173:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4820ee800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845844.664175:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4820ee800/0x21b4d561382715ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.664182:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4820ee800/0x21b4d561382715ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845844.664188:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4820ee800/0x21b4d561382715ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845844.664193:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845844.664207:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4820ee800/0x21b4d561382715ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.664212:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845844.665397:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788845844.665415:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702296832:12345-0@lo:104: Request processed in 4262us (4915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.665427:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788845844.665467:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845844.665482:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702296960:12345-0@lo:104: 00010000:00010000:0.0:1788845844.665579:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e4820ee200/0x21b4d56138271573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.665668:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845844.665674:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702296960:12345-0@lo:104: Request processed in 199us (4685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.665680:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788845844.666376:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845844.666385:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4820ee200/0x21b4d56138271573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666395:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4820ee200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845844.666399:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4820ee200/0x21b4d56138271573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666408:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4820ee200/0x21b4d56138271573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845844.666414:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4820ee200/0x21b4d56138271573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845844.666420:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845844.666458:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4820ee200/0x21b4d56138271573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666465:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845844.666484:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4820ee200/0x21b4d56138271573 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666491:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4820ee200/0x21b4d56138271573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827157a expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666506:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845844.666508:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845844.666510:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845844.666556:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702297344:0@lo:103: 00000100:00100000:1.0:1788845844.666604:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.666656:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702297088 00000100:00100000:1.0:1788845844.666675:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702297088 00010000:00010000:1.0:1788845844.666700:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e6800/0x21b4d56138271629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271622 expref: 17 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845844.666722:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702297344 00000100:00100000:1.0:1788845844.666724:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702297344 00010000:00010000:1.0:1788845844.666734:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e6000/0x21b4d5613827157a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271573 expref: 18 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845844.666745:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845844.666751:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3640:x1875740702297088:12345-0@lo:103: 00010000:00010000:1.0:1788845844.666760:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845844.666764:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e6800/0x21b4d56138271629 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271622 expref: 18 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666774:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e6800/0x21b4d56138271629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271622 expref: 18 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666787:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e6800/0x21b4d56138271629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271622 expref: 18 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666798:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845844.666823:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:3640:x1875740702297088:12345-0@lo:103: Request processed in 72us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.666829:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845844.666847:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845844.666852:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:3642:x1875740702297344:12345-0@lo:103: 00010000:00010000:1.0:1788845844.666859:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845844.666863:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e6000/0x21b4d5613827157a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271573 expref: 16 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666879:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e6000/0x21b4d5613827157a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271573 expref: 16 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.666888:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845844.666914:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:3642:x1875740702297344:12345-0@lo:103: Request processed in 62us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.666920:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845844.666948:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702297344:0@lo:103: 00010000:00010000:3.0:1788845844.667297:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4820ee800/0x21b4d561382715ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667306:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4820ee800/0x21b4d561382715ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382715f1 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667321:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845844.667331:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845844.667333:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845844.667407:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702297088:0@lo:103: 00000100:00100000:2.0:1788845844.667422:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845844.667429:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702297216:0@lo:103: 00000100:00100000:2.0:1788845844.667464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.667552:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702297216 00000100:00100000:3.0:1788845844.667557:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702297216 00010000:00010000:3.0:1788845844.667577:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e7000/0x21b4d561382715f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382715ea expref: 16 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845844.667592:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845844.667598:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:3640:x1875740702297216:12345-0@lo:103: 00010000:00010000:3.0:1788845844.667605:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845844.667609:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e7000/0x21b4d561382715f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382715ea expref: 16 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667618:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e7000/0x21b4d561382715f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382715ea expref: 16 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667629:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7000/0x21b4d561382715f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382715ea expref: 16 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667749:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667821:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667837:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667845:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667852:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667864:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667870:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788845844.667874:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667883:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667892:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.667901:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845844.667943:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:3640:x1875740702297216:12345-0@lo:103: Request processed in 345us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845844.667949:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788845844.667988:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845844.668041:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702297216:0@lo:103: 00010000:00010000:2.0:1788845844.668164:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e6000/0x21b4d5613827157a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271573 expref: 14 pid: 6511 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.668174:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702296960:0@lo:104: 00010000:00010000:2.0:1788845844.668197:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.668205:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.668210:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.668216:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c600/0x21b4d561382716ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788845844.668240:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788845844.673445:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:8424:x1875740702296064:12345-0@lo:253: Request processed in 22466us (23153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.673459:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788845844.673847:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702296064:0@lo:253: 10000000:01000000:1.0:1788845844.673862:0:8424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788845844.673866:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788845844.673868:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788845844.673869:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788845844.673870:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788845844.673871:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788845844.673872:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788845844.673874:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788845844.673876:0:8424:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788845844.673877:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788845844.673878:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788845844.673901:0:8424:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e451767800 from lustre-OST0000 10000000:01000000:1.0:1788845844.673929:0:8424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788845844.673932:0:8424:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788845844.673940:0:8424:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e450c6cd28 local copy 10000000:01000000:1.0:1788845844.673943:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788845844.673976:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.673986:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.674013:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845844.674031:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702297472:0@lo:101: 00000100:00100000:1.0:1788845844.674390:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.674428:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.674475:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702297472 00000100:00100000:2.0:1788845844.674481:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702297472 00000100:00100000:2.0:1788845844.674933:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788845844.674944:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:8424:x1875740702297472:12345-0@lo:101: 00010000:00010000:2.0:1788845844.674957:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845844.674972:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c600/0x21b4d561382716bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382716b5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.674995:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c600/0x21b4d561382716bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382716b5 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.675005:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c600/0x21b4d561382716bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382716b5 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.675014:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c600, rc 0) 00000100:00100000:2.0:1788845844.675067:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702297472:12345-0@lo:101: Request processed in 125us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.675073:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788845844.675174:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702297472:0@lo:101: 00010000:00010000:3.0:1788845844.675189:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.675197:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845844.675371:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702297600:0@lo:501: 00000100:00100000:3.0:1788845844.675400:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.675425:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47519e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.675888:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702297600 00000100:00100000:2.0:1788845844.675894:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702297600 00000100:00100000:2.0:1788845844.675970:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845844.675978:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702297600:12345-0@lo:501: 00000100:00100000:2.0:1788845844.676062:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702297600:12345-0@lo:501: Request processed in 83us (660us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845844.676075:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788845844.676134:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702297600:0@lo:501: 10000000:01000000:3.0:1788845844.676149:0:8424:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788845844.676169:0:8424:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788845844.676176:0:8424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.676185:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.676192:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.676216:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788845844.676257:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e451767800 10000000:01000000:3.0:1788845844.676262:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788845844.676266:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788845844.676269:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788845844.676273:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788845844.676276:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788845844.676296:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.676304:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.676312:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845844.676325:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702297728:0@lo:101: 00000100:00100000:3.0:1788845844.676351:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845844.676399:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845844.676405:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.676412:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4536e6600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845844.676416:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.676423:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845844.676429:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845844.676434:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845844.676452:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.676458:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845844.676476:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.676482:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4536e6600/0x21b4d561382716b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d561382716bc expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.676498:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845844.676500:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845844.676501:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845844.676513:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702297856:0@lo:103: 00000100:00100000:1.0:1788845844.676572:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.676613:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702297856 00000100:00100000:1.0:1788845844.676618:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702297856 00000100:00100000:1.0:1788845844.676649:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845844.676657:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:3643:x1875740702297856:12345-0@lo:103: 00010000:00010000:1.0:1788845844.676666:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845844.676679:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c600/0x21b4d561382716bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d561382716b5 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.676702:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845844.676731:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:3643:x1875740702297856:12345-0@lo:103: Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.676737:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788845844.677116:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702297856:0@lo:103: 00000100:00100000:3.0:1788845844.677389:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47519ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845844.677453:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702297728 00000100:00100000:0.0:1788845844.677467:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702297728 00000100:00100000:0.0:1788845844.677492:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788845844.677500:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+13:8424:x1875740702297728:12345-0@lo:101: 00010000:00010000:0.0:1788845844.677512:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845844.677560:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382716c3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.677581:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382716c3 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.677591:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382716c3 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.677599:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031400, rc 0) 00000100:00100000:0.0:1788845844.677639:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702297728:12345-0@lo:101: Request processed in 140us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.677645:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788845844.677904:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702297728:0@lo:101: 00010000:00010000:3.0:1788845844.677919:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.677927:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845844.678008:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702297984:0@lo:501: 00000100:00100000:3.0:1788845844.678054:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.678077:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47519ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.678211:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702297984 00000100:00100000:2.0:1788845844.678216:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702297984 00000100:00100000:2.0:1788845844.678262:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788845844.678270:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702297984:12345-0@lo:501: 00000100:00100000:2.0:1788845844.678365:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702297984:12345-0@lo:501: Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.678371:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788845844.678557:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702297984:0@lo:501: 00000100:00100000:3.0:1788845844.678580:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298112:0@lo:503: 00000100:00100000:3.0:1788845844.678619:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.678638:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47519ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.678857:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702298112 00000100:00100000:2.0:1788845844.678862:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702298112 00000100:00100000:2.0:1788845844.678882:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788845844.678888:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702298112:12345-0@lo:503: 00000100:00100000:2.0:1788845844.679055:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702298112:12345-0@lo:503: Request processed in 166us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.679061:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788845844.679303:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298112:0@lo:503: 00000040:00080000:3.0:1788845844.679922:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845844.680011:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298240:0@lo:502: 00000100:00100000:3.0:1788845844.680137:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.680206:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47519ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845844.680326:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702298240 00000100:00100000:0.0:1788845844.680333:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702298240 00000100:00100000:0.0:1788845844.680399:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788845844.680407:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702298240:12345-0@lo:502: 00000100:00100000:0.0:1788845844.680510:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702298240:12345-0@lo:502: Request processed in 104us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.680555:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788845844.681904:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298240:0@lo:502: 00000040:00080000:3.0:1788845844.682140:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788845844.682169:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788845844.682181:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788845844.682192:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788845844.682205:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788845844.682228:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788845844.682279:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298368:0@lo:502: 00000100:00100000:3.0:1788845844.682340:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.686604:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47519ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.687894:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702298368 00000100:00100000:2.0:1788845844.687907:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702298368 00000100:00100000:2.0:1788845844.687966:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788845844.687977:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702298368:12345-0@lo:502: 00000100:00100000:2.0:1788845844.688139:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702298368:12345-0@lo:502: Request processed in 164us (5798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.688146:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788845844.688389:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298368:0@lo:502: 00000040:00080000:3.0:1788845844.688466:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788845844.688479:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788845844.689024:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788845844.689033:0:8447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788845844.689049:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845844.689051:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788845844.689057:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788845844.689083:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90e341e54d28) 00000020:00000080:3.0:1788845844.689106:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788845844.689113:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788845844.689172:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e451767800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788845844.689180:0:8447:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788845844.689188:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21b4d561382716d8 00010000:00010000:3.0:1788845844.697398:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788845844.697847:0:8447:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788845844.700440:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788845844.700859:0:8447:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788845844.705513:0:8447:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788845844.705961:0:8447:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788845844.714785:0:8447:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788845844.723583:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788845844.723595:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845844.723601:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845844.723603:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788845844.723606:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845844.723610:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845844.723617:0:8447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788845844.723621:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788845844.723623:0:8447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788845844.723650:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845844.723654:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845844.723655:0:8447:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788845844.723659:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788845844.723853:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788845844.723882:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788845844.723906:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.723930:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845844.723937:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451767800 from 1 10000000:01000000:2.0:1788845844.723939:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845844.723973:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.723981:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.723992:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.724013:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298496:0@lo:101: 00000100:00100000:2.0:1788845844.724090:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.724141:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845844.724345:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702298496 00000100:00100000:0.0:1788845844.724352:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702298496 00000100:00100000:0.0:1788845844.724400:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788845844.724409:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:8424:x1875740702298496:12345-0@lo:101: 00010000:00010000:0.0:1788845844.724421:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845844.724441:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382716df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.724464:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382716df expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.724476:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382716df expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.724485:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031800, rc 0) 00000100:00100000:0.0:1788845844.724556:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702298496:12345-0@lo:101: Request processed in 148us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.724562:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788845844.724706:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298496:0@lo:101: 00010000:00010000:2.0:1788845844.724721:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.724730:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.724814:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298624:0@lo:501: 00000100:00100000:2.0:1788845844.724841:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.724869:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845844.725036:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702298624 00000100:00100000:0.0:1788845844.725051:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702298624 00000100:00100000:0.0:1788845844.725082:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788845844.725089:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702298624:12345-0@lo:501: 00000100:00100000:0.0:1788845844.725177:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702298624:12345-0@lo:501: Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.725183:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788845844.725410:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298624:0@lo:501: 00000100:00100000:3.0:1788845844.725439:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298752:0@lo:503: 00000100:00100000:3.0:1788845844.725479:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.725500:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47519ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.725557:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702298752 00000100:00100000:2.0:1788845844.725561:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702298752 00000100:00100000:2.0:1788845844.725589:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788845844.725596:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702298752:12345-0@lo:503: 00000100:00100000:2.0:1788845844.725672:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702298752:12345-0@lo:503: Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.725679:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788845844.725906:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298752:0@lo:503: 00000040:00080000:3.0:1788845844.726200:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845844.726833:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298880:0@lo:502: 00000100:00100000:3.0:1788845844.726885:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.727005:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47519ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.737839:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702298880 00000100:00100000:2.0:1788845844.737855:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702298880 00000100:00100000:2.0:1788845844.737923:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788845844.737933:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702298880:12345-0@lo:502: 00000100:00100000:2.0:1788845844.738117:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702298880:12345-0@lo:502: Request processed in 184us (11230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.738124:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788845844.738195:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702298880:0@lo:502: 00000040:00080000:2.0:1788845844.738414:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788845844.738441:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788845844.738470:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299008:0@lo:502: 00000100:00100000:2.0:1788845844.738511:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.742297:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845844.742949:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702299008 00000100:00100000:0.0:1788845844.742961:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702299008 00000100:00100000:0.0:1788845844.743150:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788845844.743162:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702299008:12345-0@lo:502: 00000100:00100000:0.0:1788845844.743326:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8424:x1875740702299008:12345-0@lo:502: Request processed in 166us (4813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.743386:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299008:0@lo:502: 00000040:00080000:2.0:1788845844.743461:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788845844.743474:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788845844.746774:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845844.746787:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845844.746790:0:8451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788845844.746797:0:8451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e451767800 00000020:00000080:2.0:1788845844.746807:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788845844.746821:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845844.746824:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845844.746825:0:8451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788845844.746828:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788845844.746876:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788845844.746901:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845844.746918:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.746931:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845844.746978:0:8424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788845844.746981:0:8424:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e451767800 10000000:01000000:2.0:1788845844.746985:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e451767800 10000000:01000000:2.0:1788845844.746989:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845844.746994:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e451767800 from 1 10000000:01000000:2.0:1788845844.746997:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845844.747029:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.747119:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.747133:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.747156:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299136:0@lo:101: 00000100:00100000:2.0:1788845844.747219:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.747263:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788845844.747352:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702299136 00000100:00100000:3.0:1788845844.747359:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702299136 00000100:00100000:3.0:1788845844.747405:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788845844.747415:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299136:12345-0@lo:101: 00010000:00010000:3.0:1788845844.747426:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845844.747439:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382716ed expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.747462:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382716ed expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.747473:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382716ed expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845844.747491:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064600, rc 0) 00000100:00100000:3.0:1788845844.747554:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8424:x1875740702299136:12345-0@lo:101: Request processed in 141us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845844.747561:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788845844.748233:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788845844.748325:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299136:0@lo:101: 00010000:00010000:2.0:1788845844.748342:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.748352:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.748438:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299264:0@lo:501: 00000100:00100000:2.0:1788845844.748471:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.748644:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845844.748731:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702299264 00000100:00100000:0.0:1788845844.748736:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702299264 00000100:00100000:0.0:1788845844.748780:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788845844.748789:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299264:12345-0@lo:501: 00000100:00100000:0.0:1788845844.748887:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299264:12345-0@lo:501: Request processed in 100us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.748893:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788845844.748970:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299264:0@lo:501: 00000100:00100000:2.0:1788845844.748993:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299392:0@lo:503: 00000100:00100000:2.0:1788845844.749026:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.749055:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845844.749150:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702299392 00000100:00100000:0.0:1788845844.749154:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702299392 00000100:00100000:0.0:1788845844.749182:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788845844.749188:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299392:12345-0@lo:503: 00000100:00100000:0.0:1788845844.749276:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299392:12345-0@lo:503: Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.749283:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788845844.749346:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299392:0@lo:503: 00000040:00080000:1.0:1788845844.749595:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788845844.749665:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299520:0@lo:502: 00000100:00100000:1.0:1788845844.749698:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.749718:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788845844.749815:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702299520 00000100:00100000:0.0:1788845844.749820:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702299520 00000100:00100000:0.0:1788845844.749850:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788845844.749856:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299520:12345-0@lo:502: 00000100:00100000:0.0:1788845844.749934:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299520:12345-0@lo:502: Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845844.749940:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788845844.750008:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299520:0@lo:502: 00000040:00080000:1.0:1788845844.750212:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788845844.750244:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788845844.750270:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788845844.750283:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788845844.750296:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788845844.750309:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788845844.750321:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788845844.750332:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788845844.750344:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788845844.750356:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788845844.750369:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788845844.750382:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788845844.750393:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788845844.750416:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788845844.750431:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788845844.750443:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788845844.750456:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788845844.750468:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788845844.750480:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788845844.750493:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788845844.750504:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788845844.750515:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788845844.750575:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788845844.750589:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788845844.750601:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788845844.750613:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788845844.750625:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788845844.750638:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788845844.750651:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788845844.750676:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788845844.750690:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788845844.750703:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788845844.750715:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788845844.750728:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788845844.750750:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788845844.750763:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788845844.750776:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788845844.750802:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299648:0@lo:502: 00000100:00100000:1.0:1788845844.750846:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.750866:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788845844.750889:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702299648 00000100:00100000:1.0:1788845844.750893:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702299648 00000100:00100000:1.0:1788845844.750919:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788845844.750925:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299648:12345-0@lo:502: 00000100:00100000:1.0:1788845844.751013:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702299648:12345-0@lo:502: Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845844.751020:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788845844.751072:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702299648:0@lo:502: 00000040:00080000:1.0:1788845844.751109:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788845844.751116:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788845844.752107:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788845844.752123:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90e46e1c19b8) 00000020:00000080:0.0:1788845844.752144:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788845844.752229:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e451767800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788845844.752232:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e451767800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788845844.752235:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e451767800 3 00010000:00080000:0.0:1788845844.752274:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e3424f2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788845844.755024:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788845844.759775:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788845844.759832:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788845844.759845:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x21b4d56138271702 00000100:00080000:0.0:1788845844.759855:0:8452:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845844.759861:0:8452:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90e3424f2800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788845844.759895:0:8452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4751cb480 x1875740702299776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788845844.759957:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702299776:0@lo:38: 00000100:00100000:2.0:1788845844.760028:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.760825:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702299776 00000100:00100000:3.0:1788845844.760834:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702299776 00000100:00100000:3.0:1788845844.760874:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845844.760882:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702299776:12345-0@lo:38: 00010000:00080000:3.0:1788845844.760905:0:6516:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1788845844.760938:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x21b4d56138271709 00000004:00100000:3.0:1788845844.760952:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788845844.760987:0:6516:0:(import.c:65:import_set_state_nolock()) ffff90e341e4c800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788845844.761226:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1788845844.761624:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788845844.761645:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90e34265b370) 00000020:00000080:1.0:1788845844.761676:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788845844.761758:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e451767800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788845844.761762:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e451767800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788845844.761764:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e451767800 3 00010000:00080000:1.0:1788845844.761788:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e47d13b000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788845844.770097:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:3.0:1788845844.773125:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875740702299776:12345-0@lo:38: Request processed in 12233us (13087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845844.773139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:00000080:1.0:1788845844.773437:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788845844.775119:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788845844.775140:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x21b4d56138271717 00000100:00080000:0.0:1788845844.775151:0:8452:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845844.775157:0:8452:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90e47d13b000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788845844.775193:0:8452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4751c8000 x1875740702299904/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788845844.775208:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1788845844.776422:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4751cb480 x1875740702299776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845844.776435:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788845844.776445:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788845844.776453:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788845844.776458:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788845844.776461:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e3424f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788845844.776467:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702299776:0@lo:38: 00000100:00100000:2.0:1788845844.776507:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702299904:0@lo:38: 00000100:00100000:2.0:1788845844.776608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845844.777245:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702299904 00000100:00100000:3.0:1788845844.777263:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702299904 00000100:00100000:3.0:1788845844.777302:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788845844.777310:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702299904:12345-0@lo:38: 00010000:00080000:3.0:1788845844.777334:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1788845844.777370:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x21b4d5613827171e 00000004:00100000:3.0:1788845844.777384:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788845844.777417:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90e341e49000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845844.777476:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875740702299904:12345-0@lo:38: Request processed in 166us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845844.777493:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788845844.777555:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e4751c8000 x1875740702299904/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845844.777564:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788845844.777569:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788845844.777575:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788845844.777578:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788845844.777581:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47d13b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788845844.777585:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702299904:0@lo:38: 00000040:00080000:0.0:1788845844.782809:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788845844.783010:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788845844.783123:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788845844.783148:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.783160:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788845844.783212:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788845844.783215:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788845844.783216:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845844.783218:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845844.783219:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845844.783221:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845844.783222:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788845844.783223:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845844.783225:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845844.783226:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845844.783227:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788845844.783231:0:8424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788845844.783234:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788845844.783235:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788845844.783237:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845844.783238:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788845844.783239:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845844.783240:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845844.783241:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788845844.783242:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788845844.783243:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788845844.783244:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845844.783774:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788845844.783800:0:8424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788845844.783817:0:8424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702300032:0@lo:253: 00000100:00100000:2.0:1788845844.783883:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.784005:0:8424:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845844.784290:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702300032 00000100:00100000:1.0:1788845844.784297:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702300032 00000100:00100000:1.0:1788845844.784371:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788845844.784380:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702300032:12345-0@lo:253: 20000000:01000000:1.0:1788845844.784411:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788845844.784423:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788845844.791431:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788845844.791451:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788845844.791485:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788845844.791491:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788845844.791512:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.791555:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42c000/0x21b4d5613827161b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271614 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.791563:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e7800/0x21b4d56138271637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271630 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.791572:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.791614:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e7800/0x21b4d56138271637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271630 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.791640:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e7800/0x21b4d56138271637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271630 expref: 16 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845844.791655:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751c8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702300160:0@lo:104: 00000100:00100000:0.0:1788845844.791724:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845844.791772:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42c000/0x21b4d5613827161b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271614 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845844.791780:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42c000/0x21b4d5613827161b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271614 expref: 16 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845844.791788:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751cb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702300288:0@lo:104: 00000100:00100000:0.0:1788845844.791807:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475198240 going to sleep for 11 seconds 00000100:00100000:2.0:1788845844.791879:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788845844.791897:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845844.791931:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:8424:x1875740702300032:12345-0@lo:253: Request processed in 7551us (8046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.791938:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702300160 00000100:00100000:1.0:1788845844.791940:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788845844.791944:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702300160 00000100:00100000:2.0:1788845844.791971:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702300288 00000100:00100000:2.0:1788845844.791974:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702300288 00000100:00100000:2.0:1788845844.791986:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845844.791993:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475213850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6531:x1875740702300160:12345-0@lo:104: 00010000:00010000:2.0:1788845844.792004:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e440031c00/0x21b4d56138271630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845844.792032:0:8424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8424:1875740702300032:0@lo:253: 10000000:01000000:3.0:1788845844.792044:0:8424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788845844.792047:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788845844.792049:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788845844.792050:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845844.792051:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845844.792053:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845844.792054:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845844.792055:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845844.792056:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845844.792058:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845844.792059:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845844.792060:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1788845844.792064:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788845844.792069:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475213850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6531:x1875740702300160:12345-0@lo:104: Request processed in 77us (346us total) trans 0 rc 0/0 00000020:02000000:3.0:1788845844.792075:0:8424:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788845844.792075:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845844.792104:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845844.792110:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6531:x1875740702300288:12345-0@lo:104: 00010000:00010000:2.0:1788845844.792118:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d56138271614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792148:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788845844.792152:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6531:x1875740702300288:12345-0@lo:104: Request processed in 43us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.792157:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788845844.792171:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788845844.792175:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e440031c00/0x21b4d56138271630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792192:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031c00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788845844.792196:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e440031c00/0x21b4d56138271630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792203:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e440031c00/0x21b4d56138271630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845844.792209:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e440031c00/0x21b4d56138271630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845844.792214:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845844.792240:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e440031c00/0x21b4d56138271630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792256:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845844.792274:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e440031c00/0x21b4d56138271630 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792281:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e440031c00/0x21b4d56138271630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271637 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792294:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845844.792297:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d56138271614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792303:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4536e7a00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788845844.792306:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d56138271614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792323:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d56138271614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845844.792329:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d56138271614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845844.792335:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788845844.792348:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d56138271614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792353:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845844.792359:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d56138271614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792366:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d56138271614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827161b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792379:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845844.792380:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845844.792382:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845844.792388:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845844.792412:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702300416:0@lo:103: 00000100:00100000:2.0:1788845844.792440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.792466:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845844.792472:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702300544:0@lo:103: 00000100:00100000:2.0:1788845844.792491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845844.792543:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702300416 00000100:00100000:2.0:1788845844.792547:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702300416 00010000:00010000:2.0:1788845844.792563:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e7800/0x21b4d56138271637 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271630 expref: 16 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.792590:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702300544 00000100:00100000:2.0:1788845844.792593:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702300544 00010000:00010000:2.0:1788845844.792604:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42c000/0x21b4d5613827161b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271614 expref: 17 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845844.792615:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845844.792621:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:3640:x1875740702300416:12345-0@lo:103: 00010000:00010000:2.0:1788845844.792630:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845844.792634:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e7800/0x21b4d56138271637 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271630 expref: 17 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792644:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e7800/0x21b4d56138271637 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271630 expref: 17 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792658:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845844.792684:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:3640:x1875740702300416:12345-0@lo:103: Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.792690:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845844.792703:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845844.792708:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:3640:x1875740702300544:12345-0@lo:103: 00010000:00010000:2.0:1788845844.792715:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845844.792719:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42c000/0x21b4d5613827161b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271614 expref: 16 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792727:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42c000/0x21b4d5613827161b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271614 expref: 16 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792738:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792751:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788845844.792763:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007076048s 00010000:00010000:2.0:1788845844.792768:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792775:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792783:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792789:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792795:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788845844.792799:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792806:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792814:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845844.792823:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845844.792846:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:3640:x1875740702300544:12345-0@lo:103: Request processed in 138us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845844.792852:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845844.792893:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702300544:0@lo:103: 00000100:00100000:2.0:1788845844.792902:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702300416:0@lo:103: 00010000:00010000:1.0:1788845844.793320:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7800/0x21b4d56138271637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271630 expref: 15 pid: 6509 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845844.793330:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751c8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702300160:0@lo:104: 00010000:00010000:1.0:1788845844.793339:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c000/0x21b4d5613827161b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271614 expref: 14 pid: 6508 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845844.793345:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751cb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702300288:0@lo:104: 00010000:00010000:1.0:1788845844.793359:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.793367:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.793372:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845844.793378:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e440031e00/0x21b4d56138271725 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788845844.803102:0:8424:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788845844.803348:0:8424:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788845844.806366:0:8424:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788845844.807045:0:8424:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788845844.807997:0:8424:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788845844.810971:0:8424:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788845844.814883:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788845844.832491:0:8424:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788845844.832501:0:8424:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788845844.836885:0:8424:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788845844.836944:0:8424:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788845844.836966:0:8424:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788845844.836997:0:8424:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788845844.839020:0:8424:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788845844.839194:0:8424:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788845845.307968:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788845845.604166:0:8508:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788845845.604388:0:8508:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788845846.330267:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845847.358348:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845847.361369:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702300672:0@lo:41: 00000100:00100000:0.0:1788845847.361439:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845847.361580:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702300672 00000100:00100000:3.0:1788845847.361589:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702300672 00000100:00100000:3.0:1788845847.361636:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788845847.361645:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702300672:12345-0@lo:41: 00000004:00000024:3.0:1788845847.361677:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788845847.361721:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702300672:12345-0@lo:41: Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845847.361727:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788845847.361855:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702300672:0@lo:41: 00010000:00010000:1.0:1788845848.377635:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845849.401947:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845849.401970:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702300800:0@lo:41: 00000100:00100000:0.0:1788845849.402035:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845849.402099:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702300800 00000100:00100000:0.0:1788845849.402107:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702300800 00000100:00100000:0.0:1788845849.402147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788845849.402154:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702300800:12345-0@lo:41: 00000004:00000024:0.0:1788845849.402182:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788845849.402230:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702300800:12345-0@lo:41: Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845849.402251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788845849.402293:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702300800:0@lo:41: 00010000:00010000:3.0:1788845849.403249:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845849.915112:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702301184:0@lo:400: 00000100:00100000:2.0:1788845849.915178:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845849.915248:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845849.915254:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702301312:0@lo:400: 00000100:00100000:2.0:1788845849.915278:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845849.915320:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702301184 00000100:00100000:2.0:1788845849.915327:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702301184 00000100:00100000:2.0:1788845849.915368:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788845849.915377:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702301184:12345-0@lo:400: 00000100:00100000:2.0:1788845849.915431:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702301184:12345-0@lo:400: Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845849.915437:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788845849.915459:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702301312 00000100:00100000:2.0:1788845849.915462:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702301312 00000100:00100000:2.0:1788845849.915488:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788845849.915494:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702301312:12345-0@lo:400: 00000100:00100000:2.0:1788845849.915542:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702301312:12345-0@lo:400: Request processed in 48us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845849.915557:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788845849.915598:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e26d80 x1875740702301312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845849.915611:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702301312:0@lo:400: 00000100:00100000:2.0:1788845849.915622:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702301184:0@lo:400: 00000100:00100000:0.0:1788845849.915762:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702300928:0@lo:400: 00000100:00100000:0.0:1788845849.915800:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845849.915831:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702301440:0@lo:400: 00000100:00100000:0.0:1788845849.915860:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845849.915901:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788845849.915907:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702301056:0@lo:400: 00000100:00100000:0.0:1788845849.915930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845849.915948:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702301568:0@lo:400: 00000100:00100000:0.0:1788845849.915969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845849.916004:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702301440 00000100:00100000:0.0:1788845849.916008:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702301440 00000100:00100000:0.0:1788845849.916036:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702301056 00000100:00100000:0.0:1788845849.916040:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702301056 00000100:00100000:0.0:1788845849.916050:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702301568 00000100:00100000:0.0:1788845849.916052:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702301568 00000100:00100000:0.0:1788845849.916065:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845849.916071:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702301440:12345-0@lo:400: 00000100:00100000:0.0:1788845849.916112:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702301440:12345-0@lo:400: Request processed in 42us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845849.916119:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788845849.916132:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845849.916137:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702301056:12345-0@lo:400: 00000100:00100000:0.0:1788845849.916163:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702301056:12345-0@lo:400: Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845849.916179:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788845849.916192:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788845849.916198:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702301568:12345-0@lo:400: 00000100:00100000:0.0:1788845849.916237:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702301568:12345-0@lo:400: Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845849.916243:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788845849.916269:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e25500 x1875740702301056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845849.916278:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702301056:0@lo:400: 00010000:00080000:0.0:1788845849.916287:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e24700 x1875740702301568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845849.916294:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702301568:0@lo:400: 00010000:00080000:0.0:1788845849.916303:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e24e00 x1875740702301440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845849.916310:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702301440:0@lo:400: 00000100:00100000:2.0:1788845849.916493:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702300928 00000100:00100000:2.0:1788845849.916498:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702300928 00000100:00100000:2.0:1788845849.916553:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788845849.916561:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:3640:x1875740702300928:12345-0@lo:400: 00000100:00100000:2.0:1788845849.916600:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:3640:x1875740702300928:12345-0@lo:400: Request processed in 40us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845849.916606:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1788845849.916630:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788845849.916634:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845849.916655:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702300928:0@lo:400: 00000001:02000400:2.0:1788845849.995011:0:8797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788845850.432721:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788845850.761293:0:8849:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788845850.761511:0:8849:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788845851.450031:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788845851.453213:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788845851.453220:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e47518c000 from 30 10000000:01000000:0.0:1788845851.453227:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845851.453301:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.453312:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.453338:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845851.453362:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702301696:0@lo:101: 00000100:00100000:0.0:1788845851.453433:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.453482:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.453504:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702301696 00000100:00100000:0.0:1788845851.453511:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702301696 00000100:00100000:0.0:1788845851.453579:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788845851.453588:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:6513:x1875740702301696:12345-0@lo:101: 00010000:00010000:0.0:1788845851.453601:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845851.453613:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827172c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.453636:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827172c expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.453646:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827172c expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.453655:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031c00, rc 0) 00000100:00100000:0.0:1788845851.453694:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702301696:12345-0@lo:101: Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.453701:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788845851.453746:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702301696:0@lo:101: 00010000:00010000:0.0:1788845851.453760:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.453783:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845851.453842:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702301824:0@lo:501: 00000100:00100000:0.0:1788845851.453867:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.453881:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.453893:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702301824 00000100:00100000:0.0:1788845851.453897:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702301824 00000100:00100000:0.0:1788845851.453920:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788845851.453926:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702301824:12345-0@lo:501: 00000100:00100000:0.0:1788845851.454035:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702301824:12345-0@lo:501: Request processed in 109us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.454042:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788845851.455684:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702301824:0@lo:501: 00000100:00100000:0.0:1788845851.455749:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702301952:0@lo:503: 00000100:00100000:0.0:1788845851.455816:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.455841:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.459479:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702301952 00000100:00100000:0.0:1788845851.459493:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702301952 00000100:00100000:0.0:1788845851.459562:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788845851.459573:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702301952:12345-0@lo:503: 00000100:00100000:0.0:1788845851.459729:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702301952:12345-0@lo:503: Request processed in 156us (3911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.459737:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788845851.459805:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702301952:0@lo:503: 00000100:00100000:2.0:1788845851.468508:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8884:1875740702302080:0@lo:502: 00000100:00100000:2.0:1788845851.468625:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.468669:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.471414:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702302080 00000100:00100000:0.0:1788845851.471427:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702302080 00000100:00100000:0.0:1788845851.471589:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788845851.471601:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8884:x1875740702302080:12345-0@lo:502: 00000100:00100000:0.0:1788845851.471753:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8884:x1875740702302080:12345-0@lo:502: Request processed in 154us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.471761:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788845851.474026:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8884:1875740702302080:0@lo:502: 00000100:00100000:2.0:1788845851.474115:0:8884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8884:1875740702302208:0@lo:502: 00000100:00100000:2.0:1788845851.474182:0:8884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.474234:0:8884:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.474641:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702302208 00000100:00100000:0.0:1788845851.474649:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702302208 00000100:00100000:0.0:1788845851.474692:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788845851.474699:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8884:x1875740702302208:12345-0@lo:502: 00000100:00100000:0.0:1788845851.474805:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:8884:x1875740702302208:12345-0@lo:502: Request processed in 106us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.474812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788845851.480388:0:8884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8884:1875740702302208:0@lo:502: 00000040:00080000:2.0:1788845851.480435:0:8884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788845851.480621:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788845851.480646:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845851.480657:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.480668:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845851.480678:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788845851.480681:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e47518c000 from 5 10000000:01000000:0.0:1788845851.480683:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788845851.480717:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.480724:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.480741:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845851.480759:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302336:0@lo:101: 00000100:00100000:0.0:1788845851.480821:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.480865:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845851.481050:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702302336 00000100:00100000:1.0:1788845851.481057:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702302336 00000100:00100000:1.0:1788845851.481107:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788845851.481116:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702302336:12345-0@lo:101: 00010000:00010000:1.0:1788845851.481128:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845851.481142:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827173a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845851.481165:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827173a expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845851.481176:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827173a expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845851.481186:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4536e7200, rc 0) 00000100:00100000:1.0:1788845851.481244:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702302336:12345-0@lo:101: Request processed in 128us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845851.481250:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788845851.483011:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302336:0@lo:101: 00010000:00010000:2.0:1788845851.483035:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.483047:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845851.483117:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302464:0@lo:256: 00000100:00100000:2.0:1788845851.483171:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.483224:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.484993:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702302464 00000100:00100000:0.0:1788845851.485006:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702302464 00000100:00100000:0.0:1788845851.485079:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788845851.485089:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702302464:12345-0@lo:256: 20000000:01000000:0.0:1788845851.485118:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788845851.485140:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788845851.485143:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788845851.485273:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702302464:12345-0@lo:256: Request processed in 184us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.485280:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788845851.485732:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302464:0@lo:256: 10000000:01000000:2.0:1788845851.485784:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788845851.485793:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.485804:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845851.485813:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788845851.485816:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1788845851.485819:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788845851.485852:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.485861:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.485894:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845851.485913:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302592:0@lo:101: 00000100:00100000:2.0:1788845851.485950:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.485981:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.487135:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702302592 00000100:00100000:0.0:1788845851.487145:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702302592 00000100:00100000:0.0:1788845851.487192:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788845851.487211:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702302592:12345-0@lo:101: 00010000:00010000:0.0:1788845851.487225:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845851.487241:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271748 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.487266:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271748 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.487277:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271748 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.487295:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030c00, rc 0) 00000100:00100000:0.0:1788845851.487353:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702302592:12345-0@lo:101: Request processed in 154us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.487360:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788845851.487828:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302592:0@lo:101: 00010000:00010000:2.0:1788845851.487846:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.487855:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845851.487933:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302720:0@lo:501: 00000100:00100000:2.0:1788845851.487968:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.488009:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845851.488170:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702302720 00000100:00100000:1.0:1788845851.488175:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702302720 00000100:00100000:1.0:1788845851.488219:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788845851.488227:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702302720:12345-0@lo:501: 00000100:00100000:1.0:1788845851.488342:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702302720:12345-0@lo:501: Request processed in 115us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845851.488348:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788845851.488645:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302720:0@lo:501: 00000100:00100000:2.0:1788845851.488674:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302848:0@lo:503: 00000100:00100000:2.0:1788845851.488721:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.488739:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845851.488894:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702302848 00000100:00100000:1.0:1788845851.488898:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702302848 00000100:00100000:1.0:1788845851.488929:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788845851.488935:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702302848:12345-0@lo:503: 00000100:00100000:1.0:1788845851.489020:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702302848:12345-0@lo:503: Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845851.489027:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788845851.489450:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702302848:0@lo:503: 00000100:00100000:1.0:1788845851.490888:0:8886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8886:1875740702302976:0@lo:502: 00000100:00100000:1.0:1788845851.490950:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845851.490988:0:8886:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.491265:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702302976 00000100:00100000:2.0:1788845851.491272:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702302976 00000100:00100000:2.0:1788845851.491315:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788845851.491322:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8886:x1875740702302976:12345-0@lo:502: 00000100:00100000:2.0:1788845851.492487:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8886:x1875740702302976:12345-0@lo:502: Request processed in 1159us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.492497:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788845851.502271:0:8886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8886:1875740702302976:0@lo:502: 00000020:01000000:1.0:1788845851.502445:0:8886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788845851.502454:0:8886:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788845851.502462:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845851.502465:0:8886:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788845851.502470:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788845851.502474:0:8886:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:1.0:1788845851.502500:0:8886:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788845851.502504:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788845851.502733:0:8886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90e3426599b8) 00000020:00000080:1.0:1788845851.502759:0:8886:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788845851.502769:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788845851.502858:0:8886:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788845851.502946:0:8886:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788845851.502955:0:8886:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d5613827175d 00010000:00080000:1.0:1788845851.502990:0:8886:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e342762000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788845851.503399:0:8886:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788845851.515231:0:8886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788845851.515256:0:8886:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788845851.515462:0:8886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845851.518439:0:8886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788845851.520381:0:8886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788845851.520591:0:8886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788845851.522714:0:8890:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845851.522721:0:8890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788845851.527625:0:8886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788845851.527642:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788845851.527685:0:8886:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788845851.527708:0:8886:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138271764 00000100:00080000:3.0:1788845851.527718:0:8886:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845851.527723:0:8886:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90e342762000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788845851.528010:0:8886:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4437a4380 x1875740702303104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788845851.528031:0:8886:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788845851.528147:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702303104:0@lo:8: 00000100:00100000:0.0:1788845851.528225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788845851.528420:0:8886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845851.528427:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845851.528429:0:8886:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788845851.528432:0:8886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845851.528436:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845851.528437:0:8886:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788845851.528441:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788845851.528442:0:8886:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788845851.528467:0:8886:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8886:1875740702303232:0@lo:502: 00000100:00100000:3.0:1788845851.528541:0:8886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845851.528563:0:8886:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d1873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.530509:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702303232 00000100:00100000:0.0:1788845851.530547:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702303232 00000100:00100000:0.0:1788845851.530614:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788845851.530625:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8886:x1875740702303232:12345-0@lo:502: 00000100:00100000:0.0:1788845851.530800:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:8886:x1875740702303232:12345-0@lo:502: Request processed in 176us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.530808:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788845851.531492:0:8886:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8886:1875740702303232:0@lo:502: 00000020:01000000:3.0:1788845851.531547:0:8886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845851.531555:0:8886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845851.531557:0:8886:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788845851.531565:0:8886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788845851.532693:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788845851.532721:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788845851.532732:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.532756:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845851.532767:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788845851.532771:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e451417000 from 30 10000000:01000000:0.0:1788845851.532788:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845851.532828:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.532837:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845851.532847:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845851.532870:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702303360:0@lo:101: 00000100:00100000:0.0:1788845851.532938:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.532992:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d806c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845851.533192:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702303360 00000100:00100000:3.0:1788845851.533209:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702303360 00000100:00100000:3.0:1788845851.533261:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788845851.533271:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702303360:12345-0@lo:101: 00010000:00010000:3.0:1788845851.533284:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845851.533296:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827176b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.533318:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827176b expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.533328:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827176b expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.533336:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065200, rc 0) 00000100:00100000:3.0:1788845851.533378:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702303360:12345-0@lo:101: Request processed in 108us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.533385:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788845851.533424:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702303360:0@lo:101: 00010000:00010000:3.0:1788845851.533437:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.533459:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845851.533537:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702303488:0@lo:501: 00000100:00100000:3.0:1788845851.533565:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845851.533584:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845851.533596:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702303488 00000100:00100000:3.0:1788845851.533599:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702303488 00000100:00100000:3.0:1788845851.533621:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788845851.533627:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702303488:12345-0@lo:501: 00000100:00100000:3.0:1788845851.533748:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702303488:12345-0@lo:501: Request processed in 108us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.533755:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788845851.533786:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702303488:0@lo:501: 00000100:00100000:3.0:1788845851.533813:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702303616:0@lo:503: 00000100:00100000:3.0:1788845851.533851:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845851.533864:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845851.533875:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702303616 00000100:00100000:3.0:1788845851.533879:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702303616 00000100:00100000:3.0:1788845851.533898:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788845851.533904:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702303616:12345-0@lo:503: 00000100:00100000:3.0:1788845851.534110:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702303616:12345-0@lo:503: Request processed in 205us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.534117:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788845851.534158:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702303616:0@lo:503: 00000100:00100000:3.0:1788845851.535093:0:8893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8893:1875740702303744:0@lo:502: 00000100:00100000:3.0:1788845851.535150:0:8893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845851.535235:0:8893:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845851.536104:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702303104 00000100:00100000:1.0:1788845851.536119:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702303104 00000100:00100000:1.0:1788845851.536160:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788845851.536167:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702303104:12345-0@lo:8: 00010000:00080000:1.0:1788845851.536197:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:1.0:1788845851.536263:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138271779 00002000:00100000:1.0:1788845851.536307:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90e47d138000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788845851.536311:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788845851.536314:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788845851.536386:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788845851.536821:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788845851.536863:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e47d13d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845851.536951:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702303104:12345-0@lo:8: Request processed in 783us (8724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845851.536968:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788845851.537006:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4437a4380 x1875740702303104/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845851.537009:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702303872:0@lo:400: 00000100:00100000:3.0:1788845851.537020:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788845851.537027:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788845851.537033:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788845851.537038:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788845851.537040:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e342762000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788845851.537064:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788845851.537069:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702303104:0@lo:8: 00000100:00100000:1.0:1788845851.537169:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845851.537217:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702304384:0@lo:400: 00000100:00100000:1.0:1788845851.537245:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845851.537269:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788845851.537277:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702304000:0@lo:400: 00000100:00100000:1.0:1788845851.537305:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845851.537330:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702304512:0@lo:400: 00000100:00100000:1.0:1788845851.537371:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845851.537409:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702304128:0@lo:400: 00000100:00100000:1.0:1788845851.537432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845851.537458:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845851.537472:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702304256:0@lo:400: 00000100:00100000:3.0:1788845851.537506:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702303872 00000100:00100000:3.0:1788845851.537513:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702303872 00000100:00100000:3.0:1788845851.537561:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702304384 00000100:00100000:3.0:1788845851.537565:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702304384 00000100:00100000:3.0:1788845851.537583:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702304512 00000100:00100000:3.0:1788845851.537586:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702304512 00000100:00100000:3.0:1788845851.537596:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702304128 00000100:00100000:3.0:1788845851.537599:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702304128 00000100:00100000:3.0:1788845851.537613:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845851.537619:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702303872:12345-0@lo:400: 00000100:00100000:3.0:1788845851.537666:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702303872:12345-0@lo:400: Request processed in 47us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.537673:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845851.537689:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845851.537695:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702304384:12345-0@lo:400: 00000100:00100000:3.0:1788845851.537750:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702304384:12345-0@lo:400: Request processed in 55us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.537757:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845851.537769:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788845851.537775:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702304512:12345-0@lo:400: 00000100:00100000:3.0:1788845851.537803:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702304512:12345-0@lo:400: Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.537808:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788845851.537819:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788845851.537824:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702304128:12345-0@lo:400: 00000100:00100000:3.0:1788845851.537847:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702304128:12345-0@lo:400: Request processed in 24us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.537852:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788845851.538197:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788845851.538213:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845851.538363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.538410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702304000 00010000:00080000:1.0:1788845851.538412:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e450c19c00 x1875740702304128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845851.538417:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702304000 00000100:00100000:1.0:1788845851.538429:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702304128:0@lo:400: 00000100:00100000:2.0:1788845851.538453:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702304256 00000100:00100000:2.0:1788845851.538458:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702304256 00000100:00100000:1.0:1788845851.538479:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788845851.538493:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788845851.538505:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702304256:12345-0@lo:400: 00000100:00100000:2.0:1788845851.538587:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702304256:12345-0@lo:400: Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.538595:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788845851.538632:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702304256:0@lo:400: 00000100:00100000:1.0:1788845851.540767:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702304000:12345-0@lo:400: 00000100:00100000:1.0:1788845851.540867:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702304000:12345-0@lo:400: Request processed in 2378us (3559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845851.540877:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845851.540939:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702304000:0@lo:400: 00010000:00080000:1.0:1788845851.540954:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47d3ae680 x1875740702304512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845851.540975:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702304512:0@lo:400: 00010000:00080000:1.0:1788845851.540988:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e450c18a80 x1875740702303872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845851.540997:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702303872:0@lo:400: 00010000:00080000:1.0:1788845851.541008:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47d3ac700 x1875740702304384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845851.541016:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702304384:0@lo:400: 00000100:00100000:0.0:1788845851.542320:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702303744 00000100:00100000:0.0:1788845851.542331:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702303744 00000100:00100000:0.0:1788845851.542379:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788845851.542388:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8893:x1875740702303744:12345-0@lo:502: 00000100:00100000:0.0:1788845851.542558:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8893:x1875740702303744:12345-0@lo:502: Request processed in 171us (7407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.542565:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000004:00080000:0.0:1788845851.542609:0:8890:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788845851.542674:0:8890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 235580153090ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788845851.542681:0:8890:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788845851.543293:0:8892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8892:1875740702304640:0@lo:700: 00000100:00100000:0.0:1788845851.544582:0:8892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.544626:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702304640 00000100:00100000:0.0:1788845851.544633:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702304640 00000100:00100000:0.0:1788845851.544680:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845851.544689:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8892:x1875740702304640:12345-0@lo:700: 00000100:00100000:0.0:1788845851.544741:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8439:1875740702304768:0@lo:700: 00000100:00100000:0.0:1788845851.544768:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.544784:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.544795:0:8892:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d806c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788845851.544889:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845851.544904:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702304768 00000100:00100000:2.0:1788845851.544908:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702304768 00000100:00100000:2.0:1788845851.544943:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845851.544950:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8439:x1875740702304768:12345-0@lo:700: 00000100:00100000:2.0:1788845851.545097:0:8893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8893:1875740702303744:0@lo:502: 00000100:00100000:2.0:1788845851.545160:0:8893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8893:1875740702304896:0@lo:502: 00000100:00100000:2.0:1788845851.545219:0:8893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.545245:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702304896 00000100:00100000:2.0:1788845851.545248:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702304896 00000100:00100000:2.0:1788845851.545443:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788845851.545451:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8893:x1875740702304896:12345-0@lo:502: 00000100:00100000:2.0:1788845851.545581:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:8893:x1875740702304896:12345-0@lo:502: Request processed in 131us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.545588:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788845851.545632:0:8893:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.545774:0:8893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8893:1875740702304896:0@lo:502: 00000040:00080000:2.0:1788845851.545795:0:8893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788845851.546081:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788845851.546105:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788845851.546115:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.546126:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845851.546134:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788845851.546137:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e451417000 from 5 10000000:01000000:3.0:1788845851.546140:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788845851.546166:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.546174:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.546192:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845851.546217:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305024:0@lo:101: 00000100:00100000:3.0:1788845851.546253:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845851.546283:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187540 going to sleep for 11 seconds 00000004:00080000:0.0:1788845851.548687:0:7446:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788845851.548802:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702305024 00000100:00100000:2.0:1788845851.548834:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702305024 00000100:00100000:2.0:1788845851.548891:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788845851.548902:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702305024:12345-0@lo:101: 00010000:00010000:2.0:1788845851.548918:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845851.548936:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271780 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.548976:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271780 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.548988:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271780 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.548997:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42dc00, rc 0) 00000100:00100000:2.0:1788845851.549069:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702305024:12345-0@lo:101: Request processed in 170us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.549076:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788845851.549127:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305024:0@lo:101: 00010000:00010000:2.0:1788845851.549144:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.549165:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845851.549238:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305152:0@lo:256: 00000100:00100000:2.0:1788845851.549272:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.549296:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.549308:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702305152 00000100:00100000:2.0:1788845851.549311:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702305152 00000100:00100000:2.0:1788845851.549340:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788845851.549347:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702305152:12345-0@lo:256: 20000000:01000000:2.0:1788845851.549360:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788845851.549375:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788845851.549378:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788845851.549453:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702305152:12345-0@lo:256: Request processed in 106us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.549460:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788845851.549488:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305152:0@lo:256: 10000000:01000000:2.0:1788845851.549552:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788845851.549559:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.549567:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845851.549575:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788845851.549578:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788845851.549581:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788845851.549605:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.549612:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.549621:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845851.549633:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305280:0@lo:101: 00000100:00100000:2.0:1788845851.552386:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.552443:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.552475:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702305280 00000100:00100000:2.0:1788845851.552482:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702305280 00000100:00100000:2.0:1788845851.552540:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788845851.552549:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702305280:12345-0@lo:101: 00010000:00010000:2.0:1788845851.552564:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845851.552581:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827178e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.552605:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827178e expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.552616:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827178e expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.552624:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c000, rc 0) 00000100:00100000:2.0:1788845851.553397:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702305280:12345-0@lo:101: Request processed in 845us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.553405:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788845851.553478:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305280:0@lo:101: 00010000:00010000:2.0:1788845851.553494:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.553504:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845851.553590:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305408:0@lo:501: 00000100:00100000:2.0:1788845851.553622:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.553637:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.555187:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702305408 00000100:00100000:2.0:1788845851.555196:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702305408 00000100:00100000:2.0:1788845851.555253:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788845851.555410:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702305408:12345-0@lo:501: 00000100:00100000:2.0:1788845851.557115:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702305408:12345-0@lo:501: Request processed in 998us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.557130:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788845851.557358:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305408:0@lo:501: 00000100:00100000:2.0:1788845851.557410:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305536:0@lo:503: 00000100:00100000:2.0:1788845851.557472:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.557507:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.557537:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702305536 00000100:00100000:2.0:1788845851.557543:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702305536 00000100:00100000:2.0:1788845851.557578:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788845851.557586:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702305536:12345-0@lo:503: 00000100:00100000:2.0:1788845851.559449:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702305536:12345-0@lo:503: Request processed in 1855us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.559472:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788845851.559565:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702305536:0@lo:503: 00000100:00100000:2.0:1788845851.560919:0:8896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8896:1875740702305664:0@lo:502: 00000100:00100000:2.0:1788845851.562940:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.562984:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702305664 00000100:00100000:2.0:1788845851.562999:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702305664 00000100:00100000:2.0:1788845851.563042:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788845851.563052:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:8896:x1875740702305664:12345-0@lo:502: 00000100:00100000:2.0:1788845851.563167:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:8896:x1875740702305664:12345-0@lo:502: Request processed in 116us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.563174:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788845851.563236:0:8896:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.563258:0:8896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8896:1875740702305664:0@lo:502: 00000020:01000000:2.0:1788845851.563287:0:8896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788845851.563295:0:8896:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788845851.563301:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845851.563304:0:8896:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788845851.563308:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788845851.563312:0:8896:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1788845851.563336:0:8896:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788845851.563338:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788845851.563362:0:8896:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90e4752eb370) 00000020:00000080:2.0:1788845851.563385:0:8896:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788845851.563392:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788845851.563488:0:8896:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788845851.563494:0:8896:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788845851.563509:0:8896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382717a3 00010000:00080000:2.0:1788845851.563565:0:8896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e4437d5000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1788845851.563832:0:8896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1788845851.571755:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788845851.579140:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8439:x1875740702304768:12345-0@lo:700: Request processed in 34183us (34363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845851.579168:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788845851.583450:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa7480 x1875740702304768/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845851.583470:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8439:1875740702304768:0@lo:700: 40000000:02000000:3.0:1788845851.583483:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:0.0:1788845851.589272:0:8896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788845851.589299:0:8896:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788845851.589562:0:8896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845851.589772:0:8896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845851.589871:0:8896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788845851.589982:0:8896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788845851.601662:0:8900:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845851.601672:0:8900:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000001:00100000:0.0:1788845851.604337:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788845851.604461:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8892:x1875740702304640:12345-0@lo:700: Request processed in 59769us (59877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.604474:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788845851.604543:0:8892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa4380 x1875740702304640/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845851.604556:0:8892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8892:1875740702304640:0@lo:700: 00000020:00000080:2.0:1788845851.605416:0:8896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788845851.605430:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788845851.605473:0:8896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788845851.605494:0:8896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382717aa 00000100:00080000:2.0:1788845851.605503:0:8896:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788845851.605508:0:8896:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e4437d5000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788845851.605572:0:8896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e341e27800 x1875740702305792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788845851.605595:0:8896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788845851.605651:0:8896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845851.605656:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845851.605658:0:8896:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788845851.605662:0:8896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845851.605666:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845851.605667:0:8896:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788845851.605670:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788845851.605672:0:8896:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788845851.605696:0:8896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8896:1875740702305920:0@lo:502: 00000100:00100000:2.0:1788845851.605758:0:8896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.605799:0:8896:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.605818:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702305920 00000100:00100000:2.0:1788845851.605824:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702305920 00000100:00100000:2.0:1788845851.605863:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788845851.605871:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:8896:x1875740702305920:12345-0@lo:502: 00000100:00100000:2.0:1788845851.605980:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:8896:x1875740702305920:12345-0@lo:502: Request processed in 109us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.605995:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788845851.606045:0:8896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:8896:1875740702305920:0@lo:502: 00000100:00100000:0.0:1788845851.606728:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702305792:0@lo:8: 00000100:00100000:0.0:1788845851.606768:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.606812:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702305792 00000100:00100000:0.0:1788845851.606816:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702305792 00000100:00100000:0.0:1788845851.606837:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845851.606842:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3639:x1875740702305792:12345-0@lo:8: 00010000:00080000:0.0:1788845851.606864:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1788845851.606895:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382717b1 00002000:00100000:0.0:1788845851.606909:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90e3424f6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788845851.606913:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788845851.606916:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788845851.606988:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788845851.607012:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90e3424f3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845851.608271:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702305792:12345-0@lo:8: Request processed in 1423us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.608281:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788845851.608337:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e27800 x1875740702305792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845851.608347:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788845851.608354:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788845851.608361:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788845851.608365:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788845851.608369:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e4437d5000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788845851.608383:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788845851.608389:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702305792:0@lo:8: 00000004:00080000:0.0:1788845851.608411:0:8900:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788845851.608469:0:8900:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 235645948145ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788845851.608476:0:8900:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1788845851.608894:0:8896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845851.608903:0:8896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845851.608906:0:8896:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845851.608910:0:8896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788845851.609852:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788845851.609875:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788845851.609885:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.609895:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845851.609905:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788845851.609907:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90e450c6cd28 from 1 10000000:01000000:2.0:1788845851.609909:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788845851.609943:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.609950:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845851.609958:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845851.609978:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702306048:0@lo:101: 00000100:00100000:2.0:1788845851.610035:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.611251:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845851.612369:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702306048 00000100:00100000:3.0:1788845851.612381:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702306048 00000100:00100000:3.0:1788845851.612488:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788845851.612499:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702306048:12345-0@lo:101: 00010000:00010000:3.0:1788845851.612514:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845851.612553:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382717b8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.612581:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382717b8 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.612593:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382717b8 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.612602:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064000, rc 0) 00000100:00100000:3.0:1788845851.612670:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702306048:12345-0@lo:101: Request processed in 173us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.612683:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788845851.612735:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702306048:0@lo:101: 00010000:00010000:3.0:1788845851.612752:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.612761:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845851.612832:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702306176:0@lo:501: 00000100:00100000:3.0:1788845851.612864:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845851.612891:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d1876c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845851.612906:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702306176 00000100:00100000:3.0:1788845851.612909:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702306176 00000100:00100000:3.0:1788845851.612932:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788845851.612938:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702306176:12345-0@lo:501: 00000100:00100000:3.0:1788845851.613010:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702306176:12345-0@lo:501: Request processed in 72us (146us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845851.613018:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000004:00080000:2.0:1788845851.613091:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788845851.614497:0:8892:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788845851.615014:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702306176:0@lo:501: 00000100:00100000:1.0:1788845851.615164:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845851.615181:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702306304:0@lo:13: 00000100:00100000:1.0:1788845851.615252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.615326:0:8892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8892:1875740702306432:0@lo:7: 00000100:00100000:2.0:1788845851.615382:0:8892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.615408:0:8892:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845851.615414:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702306432 00000100:00100000:1.0:1788845851.615421:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702306432 00000100:00100000:1.0:1788845851.615471:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845851.615479:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8892:x1875740702306432:12345-0@lo:7: 00000100:00100000:0.0:1788845851.617093:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702306304 00000100:00100000:0.0:1788845851.617103:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702306304 00000100:00100000:0.0:1788845851.617146:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788845851.617154:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875740702306304:12345-0@lo:13: 00002000:00000024:0.0:1788845851.617176:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923890176 avail 3692367872 00000100:00100000:0.0:1788845851.617259:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3641:x1875740702306304:12345-0@lo:13: Request processed in 105us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.617272:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:3.0:1788845851.617427:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788845851.617439:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845851.617451:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788845851.620625:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e26d80 x1875740702306304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845851.620650:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702306304:0@lo:13: 00000100:00100000:0.0:1788845851.624192:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702306560:0@lo:13: 00000100:00100000:0.0:1788845851.624270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.624324:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702306560 00000100:00100000:0.0:1788845851.624332:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702306560 00000100:00100000:0.0:1788845851.624386:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845851.624395:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702306560:12345-0@lo:13: 00002000:00000024:0.0:1788845851.624417:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923890176 avail 3692367872 00000100:00100000:0.0:1788845851.624464:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702306560:12345-0@lo:13: Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845851.624471:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788845851.624492:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788845851.624549:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa6300 x1875740702306560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845851.624569:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702306560:0@lo:13: 00000004:00080000:0.0:1788845851.624589:0:8904:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788845851.624610:0:8904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1875740702306688:0@lo:7: 00000100:00100000:0.0:1788845851.624636:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.624658:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788845851.624664:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788845851.624774:0:8904:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d806c0 going to sleep for 11 seconds 00002000:00080000:1.0:1788845851.626017:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788845851.626024:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788845851.626099:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8892:x1875740702306432:12345-0@lo:7: Request processed in 10618us (10713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845851.626108:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845851.626135:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702306688 00000100:00100000:1.0:1788845851.626140:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702306688 00000100:00100000:1.0:1788845851.626176:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845851.626184:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8904:x1875740702306688:12345-0@lo:7: 00010000:00080000:2.0:1788845851.627324:0:8892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e27b80 x1875740702306432/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845851.627343:0:8892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8892:1875740702306432:0@lo:7: 00000004:00080000:2.0:1788845851.627356:0:8892:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788845851.627405:0:8892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8892:1875740702306816:0@lo:5: 00000100:00100000:2.0:1788845851.627453:0:8892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.627480:0:8892:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845851.627504:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702306816 00000100:00100000:2.0:1788845851.627510:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702306816 00000100:00100000:2.0:1788845851.627565:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845851.627574:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8892:x1875740702306816:12345-0@lo:5: 00002000:00080000:2.0:1788845851.627596:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788845851.627765:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8892:x1875740702306816:12345-0@lo:5: Request processed in 192us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.627773:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788845851.627803:0:8892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e27b80 x1875740702306816/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845851.627812:0:8892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8892:1875740702306816:0@lo:5: 00000004:00080000:2.0:1788845851.627819:0:8892:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788845851.627837:0:8892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8892:1875740702306944:0@lo:5: 00000100:00100000:2.0:1788845851.627856:0:8892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845851.627877:0:8892:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788845851.627999:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702306944 00000100:00100000:3.0:1788845851.628011:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702306944 00000100:00100000:3.0:1788845851.628038:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845851.628046:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8892:x1875740702306944:12345-0@lo:5: 00002000:00080000:3.0:1788845851.628083:0:8906:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788845851.631022:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8892:x1875740702306944:12345-0@lo:5: Request processed in 2971us (3157us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788845851.631035:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788845851.631160:0:8892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e27b80 x1875740702306944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845851.631184:0:8892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8892:1875740702306944:0@lo:5: 00000004:00080000:0.0:1788845851.631209:0:8892:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788845851.631252:0:8892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8892:1875740702307072:0@lo:900: 00000100:00100000:0.0:1788845851.631298:0:8892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.631332:0:8892:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80900 going to sleep for 11 seconds 00000100:00100000:3.0:1788845851.631607:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702307072 00000100:00100000:3.0:1788845851.631614:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702307072 00000100:00100000:3.0:1788845851.631660:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788845851.631670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8892:x1875740702307072:12345-0@lo:900: 00000100:00100000:3.0:1788845851.631721:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8892:x1875740702307072:12345-0@lo:900: Request processed in 54us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845851.631729:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788845851.631850:0:8892:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa4e00 x1875740702307072/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845851.631862:0:8892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8892:1875740702307072:0@lo:900: 00002000:00080000:1.0:1788845851.631986:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788845851.631991:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788845851.632039:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8904:x1875740702306688:12345-0@lo:7: Request processed in 5855us (7401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845851.632047:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788845851.632337:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa6300 x1875740702306688/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845851.632349:0:8904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1875740702306688:0@lo:7: 00000004:00080000:0.0:1788845851.632359:0:8904:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788845851.632383:0:8904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1875740702307200:0@lo:5: 00000100:00100000:0.0:1788845851.632413:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845851.632441:0:8904:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845851.637358:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702307200 00000100:00100000:1.0:1788845851.637372:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702307200 00000100:00100000:1.0:1788845851.637424:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788845851.637443:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8904:x1875740702307200:12345-0@lo:5: 00002000:00080000:1.0:1788845851.637474:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788845851.637477:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1788845851.648432:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1788845851.648449:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788845851.648458:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788845851.648677:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8904:x1875740702307200:12345-0@lo:5: Request processed in 11234us (16260us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788845851.648688:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788845851.648936:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa6300 x1875740702307200/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845851.648948:0:8904:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788845851.648955:0:8904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1875740702307200:0@lo:5: 00000004:00080000:1.0:1788845851.649209:0:8904:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788845851.649264:0:8904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1875740702307328:0@lo:700: 00000100:00100000:1.0:1788845851.649301:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845851.649334:0:8904:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341082540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845851.649392:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702307328 00000100:00100000:0.0:1788845851.649400:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702307328 00000100:00100000:0.0:1788845851.649443:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788845851.649452:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8904:x1875740702307328:12345-0@lo:700: 00000100:00100000:2.0:1788845851.670513:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8904:x1875740702307328:12345-0@lo:700: Request processed in 21054us (21202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845851.670590:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788845851.670953:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47d3ae680 x1875740702307328/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845851.670984:0:8904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1875740702307328:0@lo:700: 00000004:02000040:1.0:1788845851.681865:0:8904:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788845851.691814:0:8904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1875740702307456:0@lo:5: 00000100:00100000:2.0:1788845851.691887:0:8904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845851.691955:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702307456 00000100:00100000:2.0:1788845851.691959:0:8904:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845851.691976:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702307456 00000100:00100000:3.0:1788845851.692029:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845851.692039:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8904:x1875740702307456:12345-0@lo:5: 00002000:00080000:3.0:1788845851.704167:0:8906:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788845851.704186:0:8906:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788845851.707299:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8904:x1875740702307456:12345-0@lo:5: Request processed in 15254us (15404us total) trans 4294967299 rc 0/0 00010000:00080000:2.0:1788845851.707306:0:8904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e24700 x1875740702307456/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845867 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845851.707312:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788845851.707323:0:8904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8904:1875740702307456:0@lo:5: 00000004:00080000:2.0:1788845851.707337:0:8904:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1788845852.474505:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845852.474734:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845852.474770:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702307584:0@lo:41: 00000100:00100000:3.0:1788845852.474841:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845852.475011:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702307584 00000100:00100000:0.0:1788845852.475020:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702307584 00000100:00100000:0.0:1788845852.475080:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845852.475089:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702307584:12345-0@lo:41: 00000004:00000024:0.0:1788845852.475124:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788845852.475187:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702307584:12345-0@lo:41: Request processed in 99us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845852.475205:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788845852.475295:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702307584:0@lo:41: 00000001:00080000:1.0:1788845852.703666:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788845853.498070:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788845853.521724:0:8960:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788845853.521995:0:8960:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788845854.392852:0:9008:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788845854.392865:0:9008:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788845854.521735:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845854.521921:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845854.525652:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702307712:0@lo:41: 00000100:00100000:3.0:1788845854.525838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845854.527422:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702307712 00000100:00100000:1.0:1788845854.527434:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702307712 00000100:00100000:1.0:1788845854.527492:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788845854.527510:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702307712:12345-0@lo:41: 00000004:00000024:1.0:1788845854.527574:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788845854.527640:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702307712:12345-0@lo:41: Request processed in 132us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845854.527647:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845854.527789:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702307712:0@lo:41: 00010000:00010000:3.0:1788845855.545819:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845856.573488:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845857.081879:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702308096:0@lo:400: 00000100:00100000:2.0:1788845857.081947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845857.081988:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702308608:0@lo:400: 00000100:00100000:2.0:1788845857.082038:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845857.082064:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788845857.082070:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702308224:0@lo:400: 00000100:00100000:2.0:1788845857.082092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845857.082113:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702308736:0@lo:400: 00000100:00100000:3.0:1788845857.082227:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702307840:0@lo:400: 00000100:00100000:3.0:1788845857.082259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845857.082278:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702308352:0@lo:400: 00000100:00100000:3.0:1788845857.082295:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845857.082309:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702308864:0@lo:400: 00000100:00100000:3.0:1788845857.082345:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702308096 00000100:00100000:3.0:1788845857.082352:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702308096 00000100:00100000:3.0:1788845857.082390:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702308352 00000100:00100000:3.0:1788845857.082393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702308352 00000100:00100000:3.0:1788845857.082409:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788845857.082417:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702308096:12345-0@lo:400: 00000100:00100000:3.0:1788845857.082467:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702308096:12345-0@lo:400: Request processed in 51us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845857.082475:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788845857.082491:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845857.082497:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702308352:12345-0@lo:400: 00000100:00100000:3.0:1788845857.082554:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702308352:12345-0@lo:400: Request processed in 57us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845857.082561:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845857.082578:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702308608 00000100:00100000:3.0:1788845857.082582:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702308608 00000100:00100000:3.0:1788845857.082692:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702308224 00000100:00100000:3.0:1788845857.082696:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702308224 00000100:00100000:3.0:1788845857.082712:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788845857.082718:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702308608:12345-0@lo:400: 00000100:00100000:3.0:1788845857.082749:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702308608:12345-0@lo:400: Request processed in 31us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845857.082755:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788845857.082766:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845857.082772:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702308224:12345-0@lo:400: 00000100:00100000:3.0:1788845857.082799:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702308224:12345-0@lo:400: Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845857.082805:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788845857.082823:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702307840 00000100:00100000:3.0:1788845857.082826:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702307840 00000100:00100000:3.0:1788845857.082850:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788845857.082856:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:3640:x1875740702307840:12345-0@lo:400: 00000100:00100000:3.0:1788845857.082884:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:3640:x1875740702307840:12345-0@lo:400: Request processed in 28us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845857.082889:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788845857.082921:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788845857.082998:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702307968:0@lo:400: 00000100:00100000:1.0:1788845857.083028:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845857.083052:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702308480:0@lo:400: 00000100:00100000:1.0:1788845857.083072:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845857.083145:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702307968 00000100:00100000:1.0:1788845857.083149:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702307968 00000100:00100000:1.0:1788845857.083176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702308480 00000100:00100000:1.0:1788845857.083179:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702308480 00000100:00100000:1.0:1788845857.083203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788845857.083208:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702307968:12345-0@lo:400: 00000100:00100000:1.0:1788845857.083242:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702307968:12345-0@lo:400: Request processed in 33us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845857.083248:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788845857.083265:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845857.083272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702308480:12345-0@lo:400: 00000100:00100000:1.0:1788845857.083297:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702308480:12345-0@lo:400: Request processed in 26us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845857.083303:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788845857.083320:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788845857.083344:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e25c00 x1875740702307968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845857.083357:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702307968:0@lo:400: 00010000:00080000:1.0:1788845857.083379:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e458334700 x1875740702308480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845857.083387:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702308480:0@lo:400: 00000100:00100000:2.0:1788845857.083791:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845857.083834:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702308096:0@lo:400: 00010000:00080000:2.0:1788845857.083848:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e458336680 x1875740702308608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845857.083869:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702308608:0@lo:400: 00010000:00080000:2.0:1788845857.083890:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e341e24000 x1875740702308224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845857.083898:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702308224:0@lo:400: 00000100:00100000:2.0:1788845857.083923:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845857.083955:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702307840:0@lo:400: 00000100:00100000:2.0:1788845857.083966:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702308352:0@lo:400: 00000100:00100000:2.0:1788845857.083985:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702308736 00000100:00100000:2.0:1788845857.083988:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702308736 00000100:00100000:2.0:1788845857.084016:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702308864 00000100:00100000:2.0:1788845857.084018:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702308864 00000100:00100000:2.0:1788845857.084033:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845857.084038:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702308736:12345-0@lo:400: 00000100:00100000:2.0:1788845857.084079:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702308736:12345-0@lo:400: Request processed in 40us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845857.084084:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788845857.084096:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788845857.084102:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702308864:12345-0@lo:400: 00000100:00080000:1.0:1788845857.084243:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845857.085202:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702308864:12345-0@lo:400: Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845857.085216:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788845857.085405:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e458335f80 x1875740702308864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845857.085416:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788845857.085442:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702308864:0@lo:400: 00000100:00100000:2.0:1788845857.085456:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845857.085466:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702308992:0@lo:13: 00000100:00100000:2.0:1788845857.085790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845857.086353:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702308992 00000100:00100000:2.0:1788845857.086362:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702308992 00000100:00100000:2.0:1788845857.086430:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845857.086440:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702308992:12345-0@lo:13: 00002000:00000024:2.0:1788845857.086466:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845857.086573:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702308992:12345-0@lo:13: Request processed in 134us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845857.086580:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788845857.087058:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e458336a00 x1875740702308736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845857.087070:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788845857.087084:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702308736:0@lo:400: 00010000:00080000:2.0:1788845857.087120:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa6a00 x1875740702308992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845857.087135:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702308992:0@lo:13: 00000100:00100000:3.0:1788845857.088330:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845857.088975:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702309120:0@lo:13: 00000100:00100000:3.0:1788845857.089031:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845857.089155:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702309120 00000100:00100000:1.0:1788845857.089171:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702309120 00000100:00100000:1.0:1788845857.089220:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788845857.089229:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702309120:12345-0@lo:13: 00002000:00000024:1.0:1788845857.089248:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845857.089297:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702309120:12345-0@lo:13: Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845857.089304:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788845857.089455:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47d3ac380 x1875740702309120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845857.089473:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702309120:0@lo:13: 00000100:00100000:3.0:1788845857.598829:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702309248:0@lo:41: 00000100:00100000:3.0:1788845857.598901:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845857.599061:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845857.601565:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702309248 00000100:00100000:1.0:1788845857.601579:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702309248 00000100:00100000:1.0:1788845857.601633:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788845857.601643:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702309248:12345-0@lo:41: 00000004:00000024:1.0:1788845857.601677:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788845857.601754:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702309248:12345-0@lo:41: Request processed in 112us (2852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845857.601762:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845857.602003:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702309248:0@lo:41: 00010000:00010000:3.0:1788845858.618017:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845859.642213:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845859.642235:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702309376:0@lo:41: 00000100:00100000:0.0:1788845859.642303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845859.642372:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702309376 00000100:00100000:0.0:1788845859.642379:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702309376 00000100:00100000:0.0:1788845859.642430:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788845859.642438:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702309376:12345-0@lo:41: 00000004:00000024:0.0:1788845859.642467:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788845859.642585:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702309376:12345-0@lo:41: Request processed in 147us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845859.642592:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788845859.642643:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702309376:0@lo:41: 00010000:00010000:2.0:1788845859.645845:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845860.670546:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845861.690620:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788845862.127374:0:9507:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788845862.127378:0:9507:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788845862.127380:0:9507:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788845862.127511:0:9507:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e342932800 00000020:01000004:3.0:1788845862.127813:0:9507:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788845862.127827:0:9507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788845862.127840:0:9507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90e341e53370) 00000020:00000080:3.0:1788845862.127857:0:9507:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788845862.158894:0:9507:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788845862.158947:0:9507:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788845862.180851:0:9507:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788845862.182757:0:9507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788845862.182778:0:9507:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788845862.182789:0:9507:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21b4d561382717cd 00000020:01000004:2.0:1788845862.182796:0:9507:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788845862.182817:0:9507:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788845862.182820:0:9507:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788845862.182825:0:9507:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788845862.182864:0:9507:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788845862.182868:0:9507:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788845862.202504:0:9507:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788845862.202564:0:9507:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788845862.202568:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788845862.202569:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845862.202571:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845862.202572:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845862.202573:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845862.202574:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845862.202576:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845862.202577:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845862.202578:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845862.202580:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845862.202581:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788845862.202584:0:9507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788845862.202586:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788845862.202588:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788845862.202589:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788845862.202590:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788845862.202591:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788845862.202592:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788845862.202593:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788845862.202594:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788845862.202595:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788845862.202596:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788845862.202600:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788845862.202622:0:9507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788845862.202638:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702309504:0@lo:253: 00000100:00100000:3.0:1788845862.202698:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845862.202736:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342968540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.202994:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702309504 00000100:00100000:2.0:1788845862.203001:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702309504 00000100:00100000:2.0:1788845862.203058:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788845862.203067:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:9507:x1875740702309504:12345-0@lo:253: 20000000:01000000:2.0:1788845862.203094:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788845862.203098:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788845862.203103:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788845862.203107:0:6508:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788845862.203370:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788845862.203483:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788845862.203498:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788845862.203515:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788845862.203543:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788845862.203558:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788845862.203572:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788845862.203679:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788845862.203694:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1788845862.203695:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1788845862.203708:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788845862.203713:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788845862.203726:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788845862.203732:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1788845862.203745:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788845862.203760:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788845862.203775:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788845862.203791:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788845862.203865:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788845862.203877:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1788845862.203878:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1788845862.203891:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788845862.203896:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788845862.203908:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788845862.203912:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1788845862.203925:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788845862.203930:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788845862.203944:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788845862.203960:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000100:00100000:0.0:1788845862.204161:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845862.204267:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702309632:0@lo:13: 00000040:00080000:2.0:1788845862.204325:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 00000100:00100000:0.0:1788845862.204328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:2.0:1788845862.204336:0:6508:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.120@tcp 20000000:01000000:2.0:1788845862.204337:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.120@tcp (null) (null) (null) 00000040:00080000:2.0:1788845862.204350:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788845862.204356:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788845862.204370:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788845862.204374:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.120@tcp (null) (null) 00000040:00080000:2.0:1788845862.204384:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788845862.204388:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788845862.204397:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788845862.204409:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788845862.204421:0:6508:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788845862.204424:0:6508:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788845862.204427:0:6508:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788845862.204481:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788845862.204484:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788845862.204712:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788845862.204737:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788845862.204751:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788845862.204834:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788845862.204852:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788845862.204866:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788845862.204874:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788845862.204875:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000100:00100000:0.0:1788845862.205656:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702310016:0@lo:400: 00000100:00100000:3.0:1788845862.205685:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702309888:0@lo:400: 00000100:00100000:0.0:1788845862.205702:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845862.205710:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845862.205732:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702310400:0@lo:400: 00000100:00100000:2.0:1788845862.206148:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702309760:0@lo:400: 00000100:00100000:2.0:1788845862.206182:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702310144:0@lo:400: 00000100:00100000:2.0:1788845862.206205:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.206236:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845862.206241:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702310528:0@lo:400: 00000100:00100000:2.0:1788845862.206263:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.206295:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702310528 00000100:00100000:2.0:1788845862.206302:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702310528 00000100:00100000:2.0:1788845862.206353:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845862.206362:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702310528:12345-0@lo:400: 00000100:00100000:2.0:1788845862.206407:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702310528:12345-0@lo:400: Request processed in 47us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.206414:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788845862.206434:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845862.206447:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.206462:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702310272:0@lo:400: 00000100:00100000:0.0:1788845862.206467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702310016 00000100:00100000:0.0:1788845862.206471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702310016 00000100:00100000:2.0:1788845862.206483:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845862.206497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702309760 00000100:00100000:0.0:1788845862.206501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702309760 00000100:00100000:2.0:1788845862.206506:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702310272 00000100:00100000:2.0:1788845862.206509:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702310272 00000100:00100000:0.0:1788845862.206516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788845862.206538:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702310016:12345-0@lo:400: 00000100:00100000:2.0:1788845862.206546:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788845862.206551:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702309760:12345-0@lo:400: 00000100:00100000:0.0:1788845862.206572:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702310016:12345-0@lo:400: Request processed in 50us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845862.206578:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788845862.206589:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702309760:12345-0@lo:400: Request processed in 38us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845862.206599:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845862.206605:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702310272:12345-0@lo:400: 00000100:00100000:0.0:1788845862.206632:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702310272:12345-0@lo:400: Request processed in 28us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845862.206638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845862.206655:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702309888 00000100:00100000:0.0:1788845862.206658:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702309888 00000100:00100000:0.0:1788845862.206680:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702310144 00000100:00100000:0.0:1788845862.206682:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702310144 00000100:00100000:0.0:1788845862.206695:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788845862.206701:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702309888:12345-0@lo:400: 00000100:00100000:3.0:1788845862.206956:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845862.206965:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702310144:12345-0@lo:400: 00000100:00100000:3.0:1788845862.207010:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702310144:12345-0@lo:400: Request processed in 46us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845862.207016:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788845862.207897:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702309632 00000100:00100000:1.0:1788845862.207903:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702309632 00000100:00100000:1.0:1788845862.207940:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788845862.207947:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702309632:12345-0@lo:13: 00002000:00000024:1.0:1788845862.207969:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845862.208010:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702309632:12345-0@lo:13: Request processed in 64us (3694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.208025:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788845862.208148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788845862.208176:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788845862.208181:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788845862.208225:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4437a4380 x1875740702309760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845862.208238:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702309760:0@lo:400: 00010000:00080000:2.0:1788845862.208249:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4437a4000 x1875740702310272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845862.208257:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702310272:0@lo:400: 00000100:00100000:2.0:1788845862.208284:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702310656:0@lo:13: 00000100:00100000:2.0:1788845862.208315:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788845862.208337:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e342a51500 x1875740702310528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845862.208345:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702310528:0@lo:400: 00000100:00100000:2.0:1788845862.208356:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702310144:0@lo:400: 00000100:00100000:1.0:1788845862.208540:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702310656 00000100:00100000:1.0:1788845862.208544:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702310656 00000100:00100000:1.0:1788845862.208561:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788845862.208566:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702310656:12345-0@lo:13: 00002000:00000024:1.0:1788845862.208575:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845862.208617:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702310656:12345-0@lo:13: Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845862.208620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702309888:12345-0@lo:400: Request processed in 1919us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.208623:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788845862.208627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788845862.208656:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4437a7b80 x1875740702310016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845862.208665:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702310016:0@lo:400: 00010000:00080000:0.0:1788845862.208676:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa5c00 x1875740702309632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845862.208688:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702309632:0@lo:13: 00000100:00100000:0.0:1788845862.208829:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845862.208863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702309888:0@lo:400: 00000100:00100000:0.0:1788845862.208880:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702310400 00000100:00100000:0.0:1788845862.208883:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702310400 20000000:01000000:1.0:1788845862.208892:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 00000100:00100000:0.0:1788845862.208919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788845862.208925:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702310400:12345-0@lo:400: 20000000:01000000:1.0:1788845862.208944:0:9514:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845862.208957:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000100:00100000:0.0:1788845862.208967:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702310400:12345-0@lo:400: Request processed in 42us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845862.208973:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788845862.209007:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4437a5f80 x1875740702310400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845862.209015:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702310400:0@lo:400: 00000040:00080000:1.0:1788845862.209086:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788845862.209106:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788845862.209120:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1788845862.209141:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788845862.209143:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000100:00080000:3.0:1788845862.209345:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788845862.209483:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47d3adf80 x1875740702310656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845862.209497:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702310656:0@lo:13: 20000000:01000000:1.0:1788845862.209781:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845862.209802:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845862.209815:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788845862.209959:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788845862.209979:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788845862.209994:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788845862.210005:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788845862.210007:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788845862.210334:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788845862.210350:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788845862.210363:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788845862.210486:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788845862.210571:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788845862.210597:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788845862.210609:0:6508:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788845862.210611:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788845862.211172:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788845862.211394:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788845862.211416:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788845862.211430:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:2.0:1788845862.211446:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788845862.211468:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211485:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382716c3 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211492:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382716ed expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211498:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827172c expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211505:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271748 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211511:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827176b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211516:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827178e expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211591:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382717b8 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211598:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211633:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382717b8 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211647:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382717b8 expref: 21 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.211672:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702310784:0@lo:104: 00000100:00100000:2.0:1788845862.211728:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845862.211811:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827178e expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.211819:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827178e expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.211827:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702310912:0@lo:104: 00000100:00100000:2.0:1788845862.211848:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845862.212942:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827176b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.212954:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827176b expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.212964:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311040:0@lo:104: 00000100:00100000:2.0:1788845862.212997:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.213013:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702310784 00000100:00100000:1.0:1788845862.213020:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702310784 00000100:00100000:3.0:1788845862.213142:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702310912 00000100:00100000:3.0:1788845862.213147:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702310912 00000100:00100000:3.0:1788845862.213173:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845862.213182:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702310784:12345-0@lo:104: 00010000:00010000:3.0:1788845862.213207:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213256:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788845862.213262:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702310784:12345-0@lo:104: Request processed in 82us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845862.213269:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788845862.213290:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788845862.213296:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702310912:12345-0@lo:104: 00010000:00010000:3.0:1788845862.213304:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213335:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788845862.213340:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702310912:12345-0@lo:104: Request processed in 45us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845862.213346:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788845862.213364:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845862.213370:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213378:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845862.213382:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213390:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845862.213397:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845862.213409:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845862.213435:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213442:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845862.213464:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213472:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d561382717b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382717bf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213483:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845862.213497:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213504:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845862.213507:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213513:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845862.213541:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845862.213547:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845862.213559:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213565:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845862.213576:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213582:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d5613827178e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271795 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.213590:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845862.213592:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845862.213594:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845862.214825:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702311296:0@lo:103: 00000100:00100000:0.0:1788845862.214873:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845862.214910:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845862.214915:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702311168:0@lo:103: 00000100:00100000:0.0:1788845862.214932:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845862.215272:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271748 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215284:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271748 expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.215294:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311424:0@lo:104: 00000100:00100000:2.0:1788845862.215320:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845862.215340:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827172c expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215363:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827172c expref: 21 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.215370:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311552:0@lo:104: 00000100:00100000:2.0:1788845862.215394:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845862.215426:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382716ed expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215434:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382716ed expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.215441:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311680:0@lo:104: 00000100:00100000:2.0:1788845862.215463:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845862.215476:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382716c3 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215483:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382716c3 expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.215489:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311808:0@lo:104: 00000100:00100000:2.0:1788845862.215501:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.215537:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702310784:0@lo:104: 00000100:00100000:2.0:1788845862.215548:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702310912:0@lo:104: 00010000:00010000:2.0:1788845862.215562:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845862.215575:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702311296 00000100:00100000:2.0:1788845862.215580:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702311296 00010000:00010000:2.0:1788845862.215612:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827178e expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.215639:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702311168 00000100:00100000:2.0:1788845862.215642:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702311168 00010000:00010000:2.0:1788845862.215653:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382717b8 expref: 23 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.215665:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845862.215671:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:3643:x1875740702311296:12345-0@lo:103: 00010000:00010000:2.0:1788845862.215681:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845862.215686:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827178e expref: 23 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215695:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827178e expref: 23 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215710:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c000/0x21b4d56138271795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827178e expref: 23 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215722:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845862.215761:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:3643:x1875740702311296:12345-0@lo:103: Request processed in 90us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.215768:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788845862.215783:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845862.215789:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:3643:x1875740702311168:12345-0@lo:103: 00010000:00010000:2.0:1788845862.215796:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845862.215800:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382717b8 expref: 21 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215808:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382717b8 expref: 21 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215824:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064000/0x21b4d561382717bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382717b8 expref: 21 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.215833:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845862.215857:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3643:x1875740702311168:12345-0@lo:103: Request processed in 68us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.215863:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788845862.215942:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788845862.215961:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.215970:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702311040 00000100:00100000:1.0:1788845862.215973:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702311040 00000100:00100000:1.0:1788845862.215991:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702311424 00000100:00100000:1.0:1788845862.215999:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702311424 00000100:00100000:1.0:1788845862.216014:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702311552 00000100:00100000:1.0:1788845862.216016:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702311552 00000100:00100000:1.0:1788845862.216023:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702311680 00000100:00100000:1.0:1788845862.216025:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702311680 00000100:00100000:1.0:1788845862.216032:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702311808 00000100:00100000:1.0:1788845862.216034:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702311808 00000100:00100000:1.0:1788845862.216057:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788845862.216065:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+7:6508:x1875740702311040:12345-0@lo:104: 00010000:00010000:1.0:1788845862.216075:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845862.216085:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702311168:0@lo:103: 00000100:00100000:0.0:1788845862.216094:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702311296:0@lo:103: 00010000:00010000:1.0:1788845862.216119:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845862.216124:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+7:6508:x1875740702311040:12345-0@lo:104: Request processed in 61us (3128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.216139:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788845862.216155:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788845862.216161:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:6508:x1875740702311424:12345-0@lo:104: 00010000:00010000:1.0:1788845862.216167:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216198:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788845862.216203:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:6508:x1875740702311424:12345-0@lo:104: Request processed in 43us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.216208:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788845862.216219:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788845862.216224:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:6508:x1875740702311552:12345-0@lo:104: 00010000:00010000:1.0:1788845862.216230:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216268:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788845862.216273:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:6508:x1875740702311552:12345-0@lo:104: Request processed in 49us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.216279:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788845862.216289:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788845862.216295:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f36f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702311680:12345-0@lo:104: 00010000:00010000:1.0:1788845862.216302:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216323:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788845862.216327:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f36f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6508:x1875740702311680:12345-0@lo:104: Request processed in 34us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.216332:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788845862.216370:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788845862.216376:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702311808:12345-0@lo:104: 00010000:00010000:1.0:1788845862.216383:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216404:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788845862.216408:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6508:x1875740702311808:12345-0@lo:104: Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.216414:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788845862.216426:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788845862.216431:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216438:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845862.216447:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216454:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845862.216461:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845862.216466:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845862.216490:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216495:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845862.216510:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216516:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e440030200/0x21b4d5613827176b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271772 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216545:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788845862.216548:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216554:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845862.216557:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216563:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845862.216586:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845862.216591:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845862.216604:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216610:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845862.216615:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216620:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138271748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827174f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216628:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788845862.216630:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216636:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031e00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845862.216638:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216645:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845862.216651:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845862.216656:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845862.216671:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216677:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845862.216688:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216694:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e440031e00/0x21b4d5613827172c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271733 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216703:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788845862.216706:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216712:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845862.216715:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216721:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845862.216727:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845862.216732:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845862.216741:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216747:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845862.216751:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216766:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d561382716ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716f4 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216776:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845862.216779:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216784:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845862.216787:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216793:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845862.216799:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845862.216804:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845862.216817:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216823:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845862.216826:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216831:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064200/0x21b4d561382716c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716ca expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.216842:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845862.216847:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845862.216849:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845862.216860:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702311936:0@lo:103: 00000100:00100000:1.0:1788845862.216886:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.216900:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702312448:0@lo:103: 00000100:00100000:1.0:1788845862.216932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.216946:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845862.216950:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702312064:0@lo:103: 00000100:00100000:1.0:1788845862.216968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.216986:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702312320:0@lo:103: 00000100:00100000:1.0:1788845862.217004:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.217013:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845862.217017:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702312192:0@lo:103: 00000100:00100000:1.0:1788845862.217034:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845862.217048:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845862.217246:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845862.217256:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702311936 00000100:00100000:2.0:1788845862.217262:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702311936 00010000:00010000:2.0:1788845862.217281:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827176b expref: 20 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.217296:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702312448 00000100:00100000:2.0:1788845862.217299:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702312448 00010000:00010000:2.0:1788845862.217309:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382716c3 expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.217318:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702312064 00000100:00100000:2.0:1788845862.217320:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702312064 00010000:00010000:2.0:1788845862.217329:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271748 expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.217338:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702312320 00000100:00100000:2.0:1788845862.217340:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702312320 00010000:00010000:2.0:1788845862.217349:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382716ed expref: 23 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.217359:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702312192 00000100:00100000:2.0:1788845862.217362:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702312192 00010000:00010000:2.0:1788845862.217369:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827172c expref: 24 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.217389:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845862.217394:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702311936:12345-0@lo:103: 00010000:00010000:2.0:1788845862.217402:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845862.217406:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827176b expref: 24 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217414:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827176b expref: 24 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217427:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845862.217465:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702311936:12345-0@lo:103: Request processed in 70us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.217471:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845862.217488:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788845862.217493:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:3640:x1875740702312448:12345-0@lo:103: 00010000:00010000:2.0:1788845862.217499:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845862.217503:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382716c3 expref: 23 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217510:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382716c3 expref: 23 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217538:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845862.217558:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:3640:x1875740702312448:12345-0@lo:103: Request processed in 66us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.217564:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788845862.217658:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788845862.217669:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:3640:x1875740702312064:12345-0@lo:103: 00010000:00010000:2.0:1788845862.217677:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845862.217680:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271748 expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217689:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271748 expref: 22 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217699:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845862.217722:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:3640:x1875740702312064:12345-0@lo:103: Request processed in 53us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.217727:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788845862.217740:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788845862.217746:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:3643:x1875740702312320:12345-0@lo:103: 00010000:00010000:2.0:1788845862.217753:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845862.217756:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382716ed expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217764:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382716ed expref: 21 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217773:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845862.217799:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:3643:x1875740702312320:12345-0@lo:103: Request processed in 53us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.217805:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788845862.217816:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845862.217822:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3643:x1875740702312192:12345-0@lo:103: 00010000:00010000:2.0:1788845862.217828:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845862.217838:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827172c expref: 20 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217847:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827172c expref: 20 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217857:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217864:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217877:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217884:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217890:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217896:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217901:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788845862.217905:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217912:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217920:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.217939:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845862.217961:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3643:x1875740702312192:12345-0@lo:103: Request processed in 139us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.217967:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788845862.218005:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702312192:0@lo:103: 00000100:00100000:2.0:1788845862.218013:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702312320:0@lo:103: 00010000:00010000:2.0:1788845862.218134:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065200/0x21b4d56138271772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827176b expref: 19 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.218147:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311040:0@lo:104: 00010000:00010000:2.0:1788845862.218161:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e440030c00/0x21b4d5613827174f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271748 expref: 18 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.218170:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311424:0@lo:104: 00010000:00010000:2.0:1788845862.218179:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e440031c00/0x21b4d56138271733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827172c expref: 17 pid: 6509 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.218187:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311552:0@lo:104: 00010000:00010000:2.0:1788845862.218196:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064600/0x21b4d561382716f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382716ed expref: 16 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.218203:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311680:0@lo:104: 00010000:00010000:2.0:1788845862.218211:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e440031400/0x21b4d561382716ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382716c3 expref: 15 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.218217:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875740702311808:0@lo:104: 00010000:00010000:2.0:1788845862.218258:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.218267:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.218273:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.218278:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42cc00/0x21b4d561382717d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788845862.218291:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788845862.221089:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702312064:0@lo:103: 00000100:00100000:1.0:1788845862.221104:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702311936:0@lo:103: 00000100:00100000:1.0:1788845862.221112:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702312448:0@lo:103: 00000100:00100000:3.0:1788845862.223644:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:9507:x1875740702309504:12345-0@lo:253: Request processed in 20571us (20938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845862.223657:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788845862.223815:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702309504:0@lo:253: 10000000:01000000:2.0:1788845862.223829:0:9507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788845862.223832:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788845862.223834:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788845862.223835:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788845862.223836:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788845862.223837:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788845862.223838:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788845862.223840:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788845862.223841:0:9507:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788845862.223843:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788845862.223844:0:9507:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788845862.223861:0:9507:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e342932800 from lustre-OST0001 10000000:01000000:2.0:1788845862.223888:0:9507:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788845862.223891:0:9507:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788845862.223898:0:9507:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e450c6cd28 local copy 10000000:01000000:2.0:1788845862.223902:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788845862.223932:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.223953:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.223963:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.223980:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702312576:0@lo:101: 00000100:00100000:2.0:1788845862.224014:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845862.224174:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702312576 00000100:00100000:3.0:1788845862.224180:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702312576 00000100:00100000:3.0:1788845862.224214:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788845862.224222:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+14:9507:x1875740702312576:12345-0@lo:101: 00010000:00010000:3.0:1788845862.224233:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845862.224246:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064a00/0x21b4d561382717e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382717db expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.224267:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064a00/0x21b4d561382717e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382717db expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.224278:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064a00/0x21b4d561382717e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382717db expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.224286:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064a00, rc 0) 00000100:00100000:3.0:1788845862.224310:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702312576:12345-0@lo:101: Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845862.224316:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788845862.224371:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.224383:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702312576:0@lo:101: 00010000:00010000:2.0:1788845862.224394:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.224402:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.224489:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702312704:0@lo:501: 00000100:00100000:2.0:1788845862.224514:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.224827:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845862.224977:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702312704 00000100:00100000:3.0:1788845862.224982:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702312704 00000100:00100000:3.0:1788845862.225007:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788845862.225014:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702312704:12345-0@lo:501: 00000100:00100000:3.0:1788845862.225083:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702312704:12345-0@lo:501: Request processed in 69us (568us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788845862.225090:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788845862.225271:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702312704:0@lo:501: 10000000:01000000:2.0:1788845862.225285:0:9507:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788845862.225303:0:9507:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788845862.225308:0:9507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225316:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225331:0:9507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225355:0:9507:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788845862.225378:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e342932800 10000000:01000000:2.0:1788845862.225382:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788845862.225386:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788845862.225389:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845862.225393:0:9507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788845862.225395:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788845862.225411:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225418:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225426:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.225437:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702312832:0@lo:101: 00000100:00100000:2.0:1788845862.225463:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.225477:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.225491:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702312832 00000100:00100000:2.0:1788845862.225494:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702312832 00000100:00100000:2.0:1788845862.225516:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788845862.225541:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702312832:12345-0@lo:101: 00010000:00010000:2.0:1788845862.225548:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845862.225557:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382717e9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225577:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382717e9 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225585:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382717e9 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225657:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42da00, rc 0) 00000100:00100000:2.0:1788845862.225686:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702312832:12345-0@lo:101: Request processed in 146us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.225692:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788845862.225723:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702312832:0@lo:101: 00010000:00010000:2.0:1788845862.225732:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.225740:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.225788:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702312960:0@lo:501: 00000100:00100000:2.0:1788845862.225811:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.225825:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.225839:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702312960 00000100:00100000:2.0:1788845862.225843:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702312960 00000100:00100000:2.0:1788845862.225864:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788845862.225870:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702312960:12345-0@lo:501: 00000100:00100000:2.0:1788845862.225946:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702312960:12345-0@lo:501: Request processed in 76us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.225952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788845862.225987:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702312960:0@lo:501: 00000100:00100000:2.0:1788845862.226011:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313088:0@lo:503: 00000100:00100000:2.0:1788845862.226174:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.226189:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.226202:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702313088 00000100:00100000:2.0:1788845862.226205:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702313088 00000100:00100000:2.0:1788845862.226226:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788845862.226231:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313088:12345-0@lo:503: 00000100:00100000:2.0:1788845862.226301:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313088:12345-0@lo:503: Request processed in 68us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.226307:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788845862.226348:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313088:0@lo:503: 00000040:00080000:2.0:1788845862.226579:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:3.0:1788845862.226698:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845862.226704:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.226713:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845862.226717:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.226725:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845862.226732:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845862.226738:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788845862.226758:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.226764:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845862.226783:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.226790:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42d600/0x21b4d561382717db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x21b4d561382717e2 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.226809:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845862.226811:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845862.226812:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845862.226884:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313344:0@lo:502: 00000100:00100000:2.0:1788845862.226919:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.226976:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.226993:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702313216:0@lo:103: 00000100:00100000:2.0:1788845862.227020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.227061:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702313216 00000100:00100000:2.0:1788845862.227066:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702313216 00000100:00100000:2.0:1788845862.227096:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845862.227114:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:3641:x1875740702313216:12345-0@lo:103: 00010000:00010000:2.0:1788845862.227124:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845862.227146:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064a00/0x21b4d561382717e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d561382717db expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.227167:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845862.227196:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:3641:x1875740702313216:12345-0@lo:103: Request processed in 83us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.227203:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845862.227233:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702313216:0@lo:103: 00000100:00100000:3.0:1788845862.227490:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702313344 00000100:00100000:3.0:1788845862.227495:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702313344 00000100:00100000:3.0:1788845862.227543:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788845862.227551:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702313344:12345-0@lo:502: 00000100:00100000:3.0:1788845862.227715:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702313344:12345-0@lo:502: Request processed in 164us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845862.227722:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788845862.227871:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313344:0@lo:502: 00000040:00080000:2.0:1788845862.228174:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788845862.228201:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788845862.228215:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788845862.228228:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788845862.228241:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788845862.228253:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788845862.228275:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313472:0@lo:502: 00000100:00100000:2.0:1788845862.228314:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.228378:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845862.228413:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702313472 00000100:00100000:3.0:1788845862.228418:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702313472 00000100:00100000:3.0:1788845862.228468:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788845862.228475:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702313472:12345-0@lo:502: 00000100:00100000:3.0:1788845862.228772:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702313472:12345-0@lo:502: Request processed in 297us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845862.228780:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788845862.228853:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313472:0@lo:502: 00000040:00080000:2.0:1788845862.228890:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788845862.228898:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788845862.229783:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788845862.229793:0:9518:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788845862.229800:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845862.229803:0:9518:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788845862.229809:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788845862.229824:0:9518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90e4752e99b8) 00000020:00000080:2.0:1788845862.229847:0:9518:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788845862.229853:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788845862.229925:0:9518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e342932800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788845862.229939:0:9518:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788845862.229947:0:9518:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21b4d561382717fe 00010000:00010000:3.0:1788845862.236325:0:9518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788845862.237343:0:9518:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788845862.240411:0:9518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788845862.240753:0:9518:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788845862.245498:0:9518:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788845862.245719:0:9518:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788845862.254843:0:9518:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788845862.255662:0:9518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788845862.255672:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845862.255677:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845862.255679:0:9518:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788845862.255682:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845862.255686:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845862.255688:0:9518:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788845862.255690:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788845862.255692:0:9518:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788845862.255828:0:9518:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845862.255832:0:9518:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845862.255833:0:9518:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845862.255836:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788845862.255984:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788845862.256011:0:9507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788845862.256032:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.256048:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845862.256056:0:9507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e342932800 from 1 10000000:01000000:3.0:1788845862.256059:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845862.256087:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.256095:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845862.256106:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845862.256125:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313600:0@lo:101: 00000100:00100000:3.0:1788845862.256207:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845862.256241:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342968840 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.257009:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702313600 00000100:00100000:2.0:1788845862.257019:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702313600 00000100:00100000:2.0:1788845862.257070:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788845862.257081:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:9507:x1875740702313600:12345-0@lo:101: 00010000:00010000:2.0:1788845862.257094:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845862.257108:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271805 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.257143:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271805 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.257154:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271805 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.257163:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788845862.257216:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313600:12345-0@lo:101: Request processed in 137us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.257224:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788845862.257285:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a51f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313600:0@lo:101: 00010000:00010000:2.0:1788845862.257300:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.257309:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.257408:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313728:0@lo:501: 00000100:00100000:2.0:1788845862.257447:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.257480:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.257496:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702313728 00000100:00100000:2.0:1788845862.257500:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702313728 00000100:00100000:2.0:1788845862.257541:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788845862.257548:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313728:12345-0@lo:501: 00000100:00100000:2.0:1788845862.257636:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313728:12345-0@lo:501: Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.257643:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788845862.257674:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313728:0@lo:501: 00000100:00100000:2.0:1788845862.257700:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313856:0@lo:503: 00000100:00100000:2.0:1788845862.257736:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.257749:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.257760:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702313856 00000100:00100000:2.0:1788845862.257764:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702313856 00000100:00100000:2.0:1788845862.257783:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788845862.257789:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313856:12345-0@lo:503: 00000100:00100000:2.0:1788845862.257880:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313856:12345-0@lo:503: Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.257886:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788845862.258238:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313856:0@lo:503: 00000040:00080000:3.0:1788845862.258476:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788845862.258614:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313984:0@lo:502: 00000100:00100000:3.0:1788845862.258654:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845862.258681:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3429689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.258799:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702313984 00000100:00100000:2.0:1788845862.258804:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702313984 00000100:00100000:2.0:1788845862.258839:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788845862.258846:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313984:12345-0@lo:502: 00000100:00100000:2.0:1788845862.258923:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702313984:12345-0@lo:502: Request processed in 76us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.258930:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788845862.258969:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702313984:0@lo:502: 00000040:00080000:2.0:1788845862.259178:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788845862.259208:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788845862.259231:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314112:0@lo:502: 00000100:00100000:2.0:1788845862.259269:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.259286:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.259300:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702314112 00000100:00100000:2.0:1788845862.259304:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702314112 00000100:00100000:2.0:1788845862.259471:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788845862.259479:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702314112:12345-0@lo:502: 00000100:00100000:2.0:1788845862.259573:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702314112:12345-0@lo:502: Request processed in 95us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.259579:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788845862.259781:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314112:0@lo:502: 00000040:00080000:2.0:1788845862.259821:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788845862.259829:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788845862.260317:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845862.260326:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845862.260328:0:9522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788845862.260335:0:9522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e342932800 00000020:00000080:1.0:1788845862.260338:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788845862.260353:0:9522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845862.260357:0:9522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845862.260358:0:9522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788845862.260361:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788845862.260487:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788845862.260511:0:9507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845862.260551:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.260562:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845862.260618:0:9507:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788845862.260621:0:9507:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e342932800 10000000:01000000:2.0:1788845862.260624:0:9507:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e342932800 10000000:01000000:2.0:1788845862.260628:0:9507:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788845862.260634:0:9507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e342932800 from 1 10000000:01000000:2.0:1788845862.260643:0:9507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845862.260668:0:9507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.260676:0:9507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.260686:0:9507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.260702:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314240:0@lo:101: 00000100:00100000:2.0:1788845862.260743:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.260769:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.260784:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702314240 00000100:00100000:2.0:1788845862.260789:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702314240 00000100:00100000:2.0:1788845862.260817:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788845862.260824:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9507:x1875740702314240:12345-0@lo:101: 00010000:00010000:2.0:1788845862.260832:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845862.260844:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271813 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.260863:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271813 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.260872:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271813 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.260880:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d600, rc 0) 00000100:00100000:2.0:1788845862.260911:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314240:12345-0@lo:101: Request processed in 87us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.260925:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788845862.260965:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314240:0@lo:101: 00010000:00010000:2.0:1788845862.260977:0:9507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.260986:0:9507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.261053:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314368:0@lo:501: 00000100:00100000:2.0:1788845862.261080:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.261094:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47501d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.262289:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702314368 00000100:00100000:2.0:1788845862.262298:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702314368 00000100:00100000:2.0:1788845862.262346:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788845862.262353:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314368:12345-0@lo:501: 00000100:00100000:2.0:1788845862.262475:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314368:12345-0@lo:501: Request processed in 121us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.262483:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788845862.262549:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314368:0@lo:501: 00000100:00100000:2.0:1788845862.262584:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314496:0@lo:503: 00000100:00100000:2.0:1788845862.263217:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.263245:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845862.263261:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702314496 00000100:00100000:2.0:1788845862.263265:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702314496 00000100:00100000:2.0:1788845862.263292:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788845862.263299:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314496:12345-0@lo:503: 00000100:00100000:2.0:1788845862.263390:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314496:12345-0@lo:503: Request processed in 91us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.263396:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788845862.263439:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314496:0@lo:503: 00000040:00080000:2.0:1788845862.264405:0:9507:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788845862.264481:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314624:0@lo:502: 00000100:00100000:2.0:1788845862.265633:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.265715:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845862.268511:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702314624 00000100:00100000:0.0:1788845862.268544:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702314624 00000100:00100000:0.0:1788845862.268624:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788845862.268634:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314624:12345-0@lo:502: 00000100:00100000:0.0:1788845862.268790:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314624:12345-0@lo:502: Request processed in 158us (3160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845862.268799:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788845862.268956:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314624:0@lo:502: 00000040:00080000:2.0:1788845862.269198:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788845862.269228:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788845862.269242:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788845862.269256:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788845862.269270:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788845862.269283:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788845862.269295:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788845862.269306:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788845862.269317:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788845862.269327:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788845862.269338:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788845862.269350:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788845862.269362:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788845862.269373:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788845862.269385:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788845862.269397:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788845862.269408:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788845862.269434:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788845862.269449:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788845862.269460:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788845862.269482:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788845862.269493:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788845862.269505:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788845862.269517:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788845862.269583:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788845862.269597:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788845862.269610:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788845862.269621:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788845862.269632:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788845862.269645:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788845862.269657:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788845862.269670:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788845862.269683:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788845862.269708:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788845862.269723:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788845862.269736:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788845862.269750:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788845862.269764:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788845862.269775:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788845862.269786:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788845862.269798:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788845862.269810:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788845862.269823:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788845862.269835:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788845862.269848:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788845862.269860:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788845862.269894:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314752:0@lo:502: 00000100:00100000:2.0:1788845862.269945:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.269974:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845862.270297:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702314752 00000100:00100000:0.0:1788845862.270304:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702314752 00000100:00100000:0.0:1788845862.270340:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788845862.270347:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314752:12345-0@lo:502: 00000100:00100000:0.0:1788845862.270460:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702314752:12345-0@lo:502: Request processed in 113us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845862.270473:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788845862.270603:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702314752:0@lo:502: 00000040:00080000:3.0:1788845862.270657:0:9507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788845862.270667:0:9507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788845862.271116:0:9523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788845862.271138:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90e341e519b8) 00000020:00000080:3.0:1788845862.271167:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788845862.271239:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e342932800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788845862.271243:0:9523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e342932800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788845862.271246:0:9523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e342932800 3 00010000:00080000:3.0:1788845862.271282:0:9523:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e342a21800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1788845862.273622:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788845862.273814:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788845862.273858:0:9523:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788845862.273871:0:9523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x21b4d56138271828 00000100:00080000:3.0:1788845862.273881:0:9523:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788845862.273887:0:9523:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e342a21800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788845862.273918:0:9523:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e342a51880 x1875740702314880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788845862.273942:0:9523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788845862.274266:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702314880:0@lo:38: 00000100:00100000:0.0:1788845862.274335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788845862.274840:0:9523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788845862.274854:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90e46e1c0000) 00000020:00000080:0.0:1788845862.274871:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788845862.274954:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e342932800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788845862.274958:0:9523:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e342932800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788845862.274960:0:9523:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e342932800 3 00010000:00080000:0.0:1788845862.274996:0:9523:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e343668000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788845862.276696:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788845862.276897:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788845862.276935:0:9523:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788845862.276947:0:9523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x21b4d56138271836 00000100:00080000:0.0:1788845862.276956:0:9523:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845862.276962:0:9523:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90e343668000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788845862.276991:0:9523:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e475fa7480 x1875740702315008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788845862.277033:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702315008:0@lo:38: 00000100:00100000:0.0:1788845862.277097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788845862.277157:0:9523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788845862.277494:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702314880 00000100:00100000:2.0:1788845862.277502:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702314880 00000100:00100000:2.0:1788845862.277558:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702315008 00000100:00100000:2.0:1788845862.277568:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702315008 00000100:00100000:2.0:1788845862.277590:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788845862.277597:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702314880:12345-0@lo:38: 00010000:00080000:2.0:1788845862.277619:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1788845862.277654:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x21b4d5613827183d 00000004:00100000:2.0:1788845862.277669:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788845862.277698:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90e342937000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845862.277750:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875740702314880:12345-0@lo:38: Request processed in 152us (3414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.277758:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788845862.277772:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788845862.277776:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702315008:12345-0@lo:38: 00010000:00080000:2.0:1788845862.277789:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1788845862.277818:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x21b4d56138271844 00000004:00100000:2.0:1788845862.277824:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788845862.277841:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90e34377f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845862.277870:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875740702315008:12345-0@lo:38: Request processed in 91us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.277876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788845862.277915:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e475fa7480 x1875740702315008/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845862.277924:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788845862.277931:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788845862.277937:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788845862.277941:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788845862.277942:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343668000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788845862.277953:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702315008:0@lo:38: 00010000:00080000:2.0:1788845862.277971:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e342a51880 x1875740702314880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788845872 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845862.277978:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788845862.277982:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788845862.277986:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788845862.277989:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788845862.277991:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e342a21800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788845862.277995:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702314880:0@lo:38: 00000100:00100000:2.0:1788845862.278108:0:9524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9524:1875740702315136:0@lo:901: 00000100:00100000:2.0:1788845862.278148:0:9524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845862.278176:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702315136 00000100:00100000:2.0:1788845862.278180:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702315136 00000100:00100000:2.0:1788845862.278215:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788845862.278222:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9524:x1875740702315136:12345-0@lo:901: 00000100:00100000:2.0:1788845862.278290:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9524:x1875740702315136:12345-0@lo:901: Request processed in 69us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845862.278297:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788845862.278313:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845862.278323:0:9524:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e709c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788845862.278335:0:9524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e4437a5f80 x1875740702315136/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788845878 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845862.278345:0:9524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9524:1875740702315136:0@lo:901: 00000040:00080000:0.0:1788845862.278734:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1788845862.278784:0:9507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788845862.278817:0:9507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845862.278832:0:9507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845862.278854:0:9507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788845862.278901:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788845862.278903:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788845862.278905:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845862.278906:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845862.278907:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845862.278908:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845862.278910:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845862.278911:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845862.278913:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845862.278914:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845862.278916:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845862.278919:0:9507:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788845862.278921:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788845862.278923:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788845862.278924:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788845862.278925:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845862.278926:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845862.278927:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845862.278928:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845862.278929:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845862.278930:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845862.278931:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845862.278932:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788845862.278947:0:9507:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788845862.278957:0:9507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702315264:0@lo:253: 00000100:00100000:0.0:1788845862.278994:0:9507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845862.279019:0:9507:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4518eee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788845862.279035:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702315264 00000100:00100000:0.0:1788845862.279039:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702315264 00000100:00100000:0.0:1788845862.279069:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788845862.279077:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702315264:12345-0@lo:253: 20000000:01000000:0.0:1788845862.281086:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788845862.281116:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788845862.293724:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788845862.293737:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788845862.293968:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788845862.293973:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788845862.293994:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294013:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827173a expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294021:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271780 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294028:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294066:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271780 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294081:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271780 expref: 17 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845862.294233:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702315392:0@lo:104: 00000100:00100000:1.0:1788845862.294298:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845862.294349:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827173a expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294358:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827173a expref: 17 pid: 6508 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845862.294367:0:6531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702315520:0@lo:104: 00000100:00100000:1.0:1788845862.294389:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.294405:0:6531:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845862.294423:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702315392 00000100:00100000:1.0:1788845862.294430:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702315392 00000100:00100000:1.0:1788845862.294467:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702315520 00000100:00100000:1.0:1788845862.294471:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702315520 00000100:00100000:1.0:1788845862.294491:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845862.294502:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6531:x1875740702315392:12345-0@lo:104: 00010000:00010000:1.0:1788845862.294514:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294579:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788845862.294585:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:6531:x1875740702315392:12345-0@lo:104: Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.294671:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845862.294695:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788845862.294702:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6531:x1875740702315520:12345-0@lo:104: 00010000:00010000:1.0:1788845862.294782:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294827:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788845862.294832:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:6531:x1875740702315520:12345-0@lo:104: Request processed in 131us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.294839:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788845862.294859:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788845862.294865:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294872:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064e00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845862.294877:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294886:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845862.294893:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845862.294899:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845862.294927:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294934:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845862.294950:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294957:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138271780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271787 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294981:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845862.294985:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.294991:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031a00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845862.294994:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295001:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845862.295007:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845862.295013:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845862.295027:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295033:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845862.295039:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295046:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e440031a00/0x21b4d5613827173a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271741 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295059:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845862.295061:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845862.295063:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845862.295070:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845862.295225:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702315648:0@lo:103: 00000100:00100000:1.0:1788845862.295259:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.295283:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845862.295288:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702315776:0@lo:103: 00000100:00100000:1.0:1788845862.295309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845862.295345:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702315648 00000100:00100000:1.0:1788845862.295349:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702315648 00010000:00010000:1.0:1788845862.295368:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271780 expref: 18 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845862.295390:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702315776 00000100:00100000:1.0:1788845862.295393:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702315776 00010000:00010000:1.0:1788845862.295405:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827173a expref: 19 pid: 6508 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845862.295418:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845862.295425:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:3642:x1875740702315648:12345-0@lo:103: 00010000:00010000:1.0:1788845862.295434:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845862.295438:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271780 expref: 19 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295448:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271780 expref: 19 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295461:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845862.295488:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:3642:x1875740702315648:12345-0@lo:103: Request processed in 63us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.295494:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845862.295508:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788845862.295513:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3642:x1875740702315776:12345-0@lo:103: 00010000:00010000:1.0:1788845862.295539:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845862.295543:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827173a expref: 18 pid: 6508 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295551:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827173a expref: 18 pid: 6508 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295562:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295570:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788845862.295581:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007076048s 00010000:00010000:1.0:1788845862.295585:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295659:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295665:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295671:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295676:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4536e7e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788845862.295679:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295686:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295700:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845862.295709:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845862.296446:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:3642:x1875740702315776:12345-0@lo:103: Request processed in 930us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.296455:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788845862.296545:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9507:x1875740702315264:12345-0@lo:253: Request processed in 17468us (17550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845862.296552:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00010000:2.0:1788845862.296713:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42dc00/0x21b4d56138271787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271780 expref: 16 pid: 6511 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.296740:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702315392:0@lo:104: 00010000:00010000:2.0:1788845862.296754:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7200/0x21b4d56138271741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827173a expref: 15 pid: 6508 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845862.296762:0:6531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875740702315520:0@lo:104: 00010000:00010000:2.0:1788845862.297080:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.297091:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.297098:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845862.297103:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7e00/0x21b4d5613827184b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845862.297219:0:9507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9507:1875740702315264:0@lo:253: 10000000:01000000:0.0:1788845862.297230:0:9507:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788845862.297234:0:9507:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788845862.297235:0:9507:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788845862.297237:0:9507:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:1.0:1788845862.297238:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702315776:0@lo:103: 00000020:01000004:0.0:1788845862.297238:0:9507:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788845862.297239:0:9507:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788845862.297240:0:9507:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788845862.297242:0:9507:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788845862.297243:0:9507:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788845862.297245:0:9507:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788845862.297246:0:9507:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788845862.297248:0:9507:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788845862.297249:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702315648:0@lo:103: 00000020:02000000:0.0:1788845862.297260:0:9507:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788845862.305874:0:9507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788845862.306042:0:9507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788845862.306709:0:9507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788845862.306879:0:9507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788845862.307183:0:9507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788845862.307434:0:9507:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788845862.308348:0:9507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788845862.319192:0:9507:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788845862.319203:0:9507:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788845862.319243:0:9507:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788845862.319295:0:9507:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788845862.319319:0:9507:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788845862.319343:0:9507:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788845862.320144:0:9507:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788845862.320332:0:9507:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788845862.715836:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845862.716267:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845862.717205:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702315904:0@lo:41: 00000100:00100000:1.0:1788845862.717413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845862.717784:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702315904 00000100:00100000:3.0:1788845862.717793:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702315904 00000100:00100000:3.0:1788845862.719292:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845862.719310:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702315904:12345-0@lo:41: 00000004:00000024:3.0:1788845862.719345:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788845862.719424:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702315904:12345-0@lo:41: Request processed in 121us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845862.719431:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788845862.719593:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702315904:0@lo:41: 00000020:00000004:1.0:1788845863.306518:0:9579:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788845863.306776:0:9579:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788845863.739110:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845864.761738:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702316032:0@lo:41: 00000100:00100000:2.0:1788845864.761812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845864.761929:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702316032 00000100:00100000:0.0:1788845864.761937:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702316032 00000100:00100000:0.0:1788845864.761990:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788845864.761999:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702316032:12345-0@lo:41: 00000004:00000024:0.0:1788845864.762031:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788845864.762082:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702316032:12345-0@lo:41: Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845864.762089:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788845864.762188:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702316032:0@lo:41: 00010000:00010000:2.0:1788845864.762667:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845865.789827:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845866.811725:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845867.325173:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702316160:0@lo:400: 00000100:00100000:1.0:1788845867.325243:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.325304:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702316672:0@lo:400: 00000100:00100000:0.0:1788845867.325325:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702316544:0@lo:400: 00000100:00100000:1.0:1788845867.325336:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.325364:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702317184:0@lo:400: 00000100:00100000:0.0:1788845867.325369:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.325398:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702317056:0@lo:400: 00000100:00100000:1.0:1788845867.325411:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.325431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.325446:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788845867.325455:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702317568:0@lo:13: 00000100:00100000:1.0:1788845867.325456:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702316288:0@lo:400: 00000100:00100000:0.0:1788845867.325492:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.325511:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.325517:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788845867.325547:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702316416:0@lo:400: 00000100:00100000:1.0:1788845867.325561:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702316800:0@lo:400: 00000100:00100000:0.0:1788845867.325578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.325602:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702316928:0@lo:400: 00000100:00100000:0.0:1788845867.325635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.325656:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702317440:0@lo:400: 00000100:00100000:0.0:1788845867.325678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.325708:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702316544 00000100:00100000:0.0:1788845867.325715:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702316544 00000100:00100000:0.0:1788845867.325750:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702316288 00000100:00100000:0.0:1788845867.325753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702316288 00000100:00100000:0.0:1788845867.325762:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702316928 00000100:00100000:0.0:1788845867.325765:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702316928 00000100:00100000:0.0:1788845867.325786:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702317440 00000100:00100000:0.0:1788845867.325789:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702317440 00000100:00100000:0.0:1788845867.325802:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845867.325809:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702316544:12345-0@lo:400: 00000100:00100000:0.0:1788845867.325853:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702316544:12345-0@lo:400: Request processed in 44us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.325860:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845867.325876:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788845867.325883:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702316288:12345-0@lo:400: 00000100:00100000:0.0:1788845867.325916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702316288:12345-0@lo:400: Request processed in 34us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.325922:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788845867.325932:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788845867.325937:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702316928:12345-0@lo:400: 00000100:00100000:0.0:1788845867.325958:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702316928:12345-0@lo:400: Request processed in 21us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.325962:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788845867.325970:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788845867.325975:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702317440:12345-0@lo:400: 00000100:00100000:0.0:1788845867.325994:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702317440:12345-0@lo:400: Request processed in 19us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.325999:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788845867.326014:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702316672 00000100:00100000:0.0:1788845867.326017:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702316672 00000100:00100000:0.0:1788845867.326038:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702316416 00000100:00100000:0.0:1788845867.326041:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702316416 00000100:00100000:0.0:1788845867.326065:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845867.326072:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702316672:12345-0@lo:400: 00000100:00100000:0.0:1788845867.326109:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702316672:12345-0@lo:400: Request processed in 38us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.326114:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845867.326123:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845867.326128:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702316416:12345-0@lo:400: 00000100:00100000:0.0:1788845867.326152:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702316416:12345-0@lo:400: Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.326166:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788845867.326187:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788845867.326221:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702316416:0@lo:400: 00010000:00080000:0.0:1788845867.326234:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e26d80 x1875740702316928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.326244:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702316928:0@lo:400: 00010000:00080000:0.0:1788845867.326254:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e25c00 x1875740702317440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.326262:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702317440:0@lo:400: 00010000:00080000:0.0:1788845867.326270:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e25880 x1875740702316544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.326278:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702316544:0@lo:400: 00000100:00100000:0.0:1788845867.326323:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702317568 00000100:00100000:0.0:1788845867.326327:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702317568 00000100:00100000:0.0:1788845867.326358:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845867.326365:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702317568:12345-0@lo:13: 00002000:00000024:0.0:1788845867.326385:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845867.326420:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702317568:12345-0@lo:13: Request processed in 56us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.326426:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788845867.326443:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702317184 00000100:00100000:0.0:1788845867.326447:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702317184 00000100:00100000:0.0:1788845867.326472:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702317056 00000100:00100000:0.0:1788845867.326476:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702317056 00000100:00100000:0.0:1788845867.326496:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845867.326510:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702317184:12345-0@lo:400: 00000100:00100000:0.0:1788845867.326566:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702317184:12345-0@lo:400: Request processed in 56us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.326572:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788845867.326583:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788845867.326589:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702317056:12345-0@lo:400: 00000100:00100000:0.0:1788845867.326613:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702317056:12345-0@lo:400: Request processed in 25us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.326619:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788845867.326644:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788845867.326660:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e27480 x1875740702317056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.326669:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702317056:0@lo:400: 00010000:00080000:0.0:1788845867.326679:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e450c1b480 x1875740702317568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.326690:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702317568:0@lo:13: 00000100:00100000:3.0:1788845867.326962:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845867.326975:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702317696:0@lo:13: 00000100:00100000:3.0:1788845867.327010:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.327043:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702317696 00000100:00100000:3.0:1788845867.327054:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702317696 00000100:00100000:3.0:1788845867.327081:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845867.327087:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702317696:12345-0@lo:13: 00002000:00000024:3.0:1788845867.327110:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845867.327143:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702317696:12345-0@lo:13: Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845867.327150:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788845867.327178:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a52300 x1875740702317696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845867.327190:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702317696:0@lo:13: 00000100:00100000:3.0:1788845867.327221:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702316160 00000100:00100000:3.0:1788845867.327225:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702316160 00000100:00100000:3.0:1788845867.327252:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788845867.327260:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:3642:x1875740702316160:12345-0@lo:400: 00000100:00100000:3.0:1788845867.327294:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:3642:x1875740702316160:12345-0@lo:400: Request processed in 34us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845867.327301:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788845867.328035:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.328070:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702317312:0@lo:400: 00000100:00100000:1.0:1788845867.328124:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.328156:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702316160:0@lo:400: 00000100:00100000:1.0:1788845867.328169:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702316672:0@lo:400: 00010000:00080000:1.0:1788845867.328182:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24000 x1875740702317184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845867.328190:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702317184:0@lo:400: 00010000:00080000:1.0:1788845867.328217:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24a80 x1875740702316288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845867.328225:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702316288:0@lo:400: 00000100:00100000:1.0:1788845867.328317:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702316800 00000100:00100000:1.0:1788845867.328322:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702316800 00000100:00100000:1.0:1788845867.328359:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702317312 00000100:00100000:1.0:1788845867.328363:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702317312 00000100:00100000:1.0:1788845867.328382:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845867.328388:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702316800:12345-0@lo:400: 00000100:00100000:1.0:1788845867.328432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702316800:12345-0@lo:400: Request processed in 45us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.328439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845867.328464:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845867.328471:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702317312:12345-0@lo:400: 00000100:00100000:1.0:1788845867.328500:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702317312:12345-0@lo:400: Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.328506:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788845867.330377:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788845867.333351:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24700 x1875740702316800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.333373:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702316800:0@lo:400: 00010000:00080000:0.0:1788845867.333391:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e27100 x1875740702317312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.333401:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702317312:0@lo:400: 00000100:00100000:1.0:1788845867.833693:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845867.833716:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702317824:0@lo:41: 00000100:00100000:1.0:1788845867.833780:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845867.833841:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845867.833854:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702317824 00000100:00100000:1.0:1788845867.833861:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702317824 00000100:00100000:1.0:1788845867.833919:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788845867.833929:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702317824:12345-0@lo:41: 00000004:00000024:1.0:1788845867.833976:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788845867.834023:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702317824:12345-0@lo:41: Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.834030:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788845867.834077:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702317824:0@lo:41: 10000000:01000000:0.0:1788845867.834279:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788845867.834283:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e451767800 from 39 10000000:01000000:0.0:1788845867.834293:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845867.834319:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.834330:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.834340:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.834354:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702317952:0@lo:101: 00000100:00100000:0.0:1788845867.834387:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.834495:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788845867.836460:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702317952 00000100:00100000:3.0:1788845867.836472:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702317952 00000100:00100000:3.0:1788845867.836588:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788845867.836599:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702317952:12345-0@lo:101: 00010000:00010000:3.0:1788845867.836616:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845867.836634:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271852 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845867.836660:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271852 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845867.836684:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271852 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845867.836694:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065400, rc 0) 00000100:00100000:3.0:1788845867.836766:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702317952:12345-0@lo:101: Request processed in 169us (2378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845867.836773:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788845867.841501:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702317952:0@lo:101: 00010000:00010000:3.0:1788845867.841552:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845867.841567:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845867.841670:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318080:0@lo:501: 00000100:00100000:3.0:1788845867.841731:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.841779:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427fe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.841892:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702318080 00000100:00100000:0.0:1788845867.841899:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702318080 00000100:00100000:0.0:1788845867.842059:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788845867.842069:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702318080:12345-0@lo:501: 00000100:00100000:0.0:1788845867.842218:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702318080:12345-0@lo:501: Request processed in 150us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.842226:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788845867.842294:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318080:0@lo:501: 00000100:00100000:3.0:1788845867.842321:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318208:0@lo:503: 00000100:00100000:3.0:1788845867.842360:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.848064:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427fe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.849166:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702318208 00000100:00100000:1.0:1788845867.849178:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702318208 00000100:00100000:1.0:1788845867.849235:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788845867.849245:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702318208:12345-0@lo:503: 00000100:00100000:1.0:1788845867.849408:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702318208:12345-0@lo:503: Request processed in 163us (7045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.849416:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788845867.851247:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318208:0@lo:503: 00000100:00100000:1.0:1788845867.854127:0:9812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9812:1875740702318336:0@lo:502: 00000100:00100000:1.0:1788845867.854211:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.854263:0:9812:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342968cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.854321:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702318336 00000100:00100000:0.0:1788845867.854329:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702318336 00000100:00100000:0.0:1788845867.854377:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788845867.854387:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9812:x1875740702318336:12345-0@lo:502: 00000100:00100000:0.0:1788845867.854512:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9812:x1875740702318336:12345-0@lo:502: Request processed in 126us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.854536:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788845867.854633:0:9812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9812:1875740702318336:0@lo:502: 00000100:00100000:1.0:1788845867.854682:0:9812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9812:1875740702318464:0@lo:502: 00000100:00100000:1.0:1788845867.854713:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.854752:0:9812:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.855163:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702318464 00000100:00100000:0.0:1788845867.855168:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702318464 00000100:00100000:0.0:1788845867.855209:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788845867.855215:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9812:x1875740702318464:12345-0@lo:502: 00000100:00100000:0.0:1788845867.855296:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:9812:x1875740702318464:12345-0@lo:502: Request processed in 80us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.855303:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788845867.855401:0:9812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9812:1875740702318464:0@lo:502: 00000040:00080000:3.0:1788845867.855421:0:9812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788845867.855626:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788845867.855645:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845867.855655:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.855665:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845867.855675:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788845867.855677:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788845867.855680:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845867.855704:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.855710:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.855718:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.855732:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318592:0@lo:101: 00000100:00100000:0.0:1788845867.855760:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.855789:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.855838:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702318592 00000100:00100000:1.0:1788845867.855843:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702318592 00000100:00100000:1.0:1788845867.855873:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788845867.855880:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702318592:12345-0@lo:101: 00010000:00010000:1.0:1788845867.855888:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845867.855900:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271860 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.855990:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271860 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.856001:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271860 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.856009:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4536e7800, rc 0) 00000100:00100000:1.0:1788845867.856044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702318592:12345-0@lo:101: Request processed in 165us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.856050:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788845867.856123:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318592:0@lo:101: 00010000:00010000:3.0:1788845867.856134:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845867.856142:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845867.856187:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318720:0@lo:501: 00000100:00100000:3.0:1788845867.856211:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.856231:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427fe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.856270:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702318720 00000100:00100000:1.0:1788845867.856274:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702318720 00000100:00100000:1.0:1788845867.856301:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788845867.856307:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702318720:12345-0@lo:501: 00000100:00100000:1.0:1788845867.856401:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702318720:12345-0@lo:501: Request processed in 94us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.856415:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788845867.856444:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318720:0@lo:501: 00000100:00100000:1.0:1788845867.856469:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318848:0@lo:503: 00000100:00100000:1.0:1788845867.856503:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.856515:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.856546:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702318848 00000100:00100000:1.0:1788845867.856550:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702318848 00000100:00100000:1.0:1788845867.856566:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788845867.856571:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702318848:12345-0@lo:503: 00000100:00100000:1.0:1788845867.856639:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702318848:12345-0@lo:503: Request processed in 67us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.856645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788845867.856697:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702318848:0@lo:503: 00000100:00100000:1.0:1788845867.856851:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9813:1875740702318976:0@lo:502: 00000100:00100000:1.0:1788845867.856882:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.856900:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702318976 00000100:00100000:1.0:1788845867.856977:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702318976 00000100:00100000:1.0:1788845867.856997:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788845867.857002:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9813:x1875740702318976:12345-0@lo:502: 00000100:00100000:1.0:1788845867.857068:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9813:x1875740702318976:12345-0@lo:502: Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.857074:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788845867.857111:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.857124:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9813:1875740702318976:0@lo:502: 00000020:01000000:1.0:1788845867.857151:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845867.857159:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845867.857162:0:9813:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788845867.857167:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788845867.857169:0:9813:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788845867.857183:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9813:1875740702319104:0@lo:502: 00000100:00100000:1.0:1788845867.857212:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.857229:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702319104 00000100:00100000:1.0:1788845867.857232:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702319104 00000100:00100000:1.0:1788845867.857247:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788845867.857252:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9813:x1875740702319104:12345-0@lo:502: 00000100:00100000:1.0:1788845867.857304:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:9813:x1875740702319104:12345-0@lo:502: Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.857310:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788845867.857336:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.857347:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9813:1875740702319104:0@lo:502: 00000020:01000000:1.0:1788845867.857365:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845867.857368:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845867.857370:0:9813:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788845867.857373:0:9813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788845867.857455:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788845867.857473:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788845867.857481:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.857489:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845867.857497:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788845867.857504:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e47518c000 from 39 10000000:01000000:1.0:1788845867.857507:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788845867.857547:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.857555:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.857564:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845867.857574:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702319232:0@lo:101: 00000100:00100000:1.0:1788845867.857598:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.857611:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.857622:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702319232 00000100:00100000:1.0:1788845867.857625:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702319232 00000100:00100000:1.0:1788845867.857641:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788845867.857647:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702319232:12345-0@lo:101: 00010000:00010000:1.0:1788845867.857654:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845867.857664:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827186e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.857681:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827186e expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.857690:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827186e expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.857696:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4536e6000, rc 0) 00000100:00100000:1.0:1788845867.857721:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702319232:12345-0@lo:101: Request processed in 75us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.857734:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788845867.857763:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702319232:0@lo:101: 00010000:00010000:1.0:1788845867.857772:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.857780:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845867.857819:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702319360:0@lo:501: 00000100:00100000:1.0:1788845867.857842:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.857855:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.857865:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702319360 00000100:00100000:1.0:1788845867.857868:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702319360 00000100:00100000:1.0:1788845867.857885:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788845867.857891:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702319360:12345-0@lo:501: 00000100:00100000:1.0:1788845867.858635:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702319360:12345-0@lo:501: Request processed in 742us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.858643:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788845867.861427:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702319360:0@lo:501: 00000100:00100000:0.0:1788845867.861499:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702319488:0@lo:503: 00000100:00100000:0.0:1788845867.861587:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.861624:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.861646:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702319488 00000100:00100000:0.0:1788845867.861652:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702319488 00000100:00100000:0.0:1788845867.861695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788845867.861703:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702319488:12345-0@lo:503: 00000100:00100000:0.0:1788845867.861805:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702319488:12345-0@lo:503: Request processed in 102us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.861812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788845867.861857:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702319488:0@lo:503: 00000100:00100000:1.0:1788845867.862834:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9814:1875740702319616:0@lo:502: 00000100:00100000:1.0:1788845867.862887:0:9814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.862994:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702319616 00000100:00100000:0.0:1788845867.863001:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702319616 00000100:00100000:0.0:1788845867.863033:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788845867.863042:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:9814:x1875740702319616:12345-0@lo:502: 00000100:00100000:0.0:1788845867.870221:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:9814:x1875740702319616:12345-0@lo:502: Request processed in 7169us (7323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.870238:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788845867.870447:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4518eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.870473:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9814:1875740702319616:0@lo:502: 00000100:00100000:1.0:1788845867.870572:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9814:1875740702319744:0@lo:502: 00000100:00100000:1.0:1788845867.870622:0:9814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.870714:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4518eecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845867.870782:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702319744 00000100:00100000:3.0:1788845867.870789:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702319744 00000100:00100000:3.0:1788845867.870836:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788845867.870845:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:9814:x1875740702319744:12345-0@lo:502: 00000100:00100000:3.0:1788845867.871039:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:9814:x1875740702319744:12345-0@lo:502: Request processed in 195us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845867.871046:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788845867.871644:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9814:1875740702319744:0@lo:502: 00000040:00080000:1.0:1788845867.871673:0:9814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788845867.872025:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788845867.872061:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845867.872072:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.872084:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845867.872103:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788845867.872123:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e47518c000 from 6 10000000:01000000:0.0:1788845867.872127:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788845867.872157:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.872165:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.872173:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.872190:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702319872:0@lo:101: 00000100:00100000:0.0:1788845867.872232:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.872272:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.872662:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702319872 00000100:00100000:1.0:1788845867.872668:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702319872 00000100:00100000:1.0:1788845867.872713:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788845867.872722:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702319872:12345-0@lo:101: 00010000:00010000:1.0:1788845867.872732:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845867.872745:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4536e7000/0x21b4d56138271883 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827187c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.872766:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e7000/0x21b4d56138271883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827187c expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.872776:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4536e7000/0x21b4d56138271883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827187c expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.872784:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4536e7000, rc 0) 00000100:00100000:1.0:1788845867.872821:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702319872:12345-0@lo:101: Request processed in 100us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.872828:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788845867.873121:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702319872:0@lo:101: 00010000:00010000:0.0:1788845867.873133:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.873141:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.873190:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702320000:0@lo:256: 00000100:00100000:0.0:1788845867.873223:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.873251:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.873320:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702320000 00000100:00100000:1.0:1788845867.873324:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702320000 00000100:00100000:1.0:1788845867.873355:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788845867.873362:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702320000:12345-0@lo:256: 20000000:01000000:1.0:1788845867.873376:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788845867.873391:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788845867.873395:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788845867.873465:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702320000:12345-0@lo:256: Request processed in 103us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.873479:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788845867.873959:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702320000:0@lo:256: 10000000:01000000:0.0:1788845867.874006:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788845867.874013:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.874030:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845867.874038:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788845867.874040:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788845867.874043:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788845867.874062:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.874069:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.874077:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.874099:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702320128:0@lo:101: 00000100:00100000:0.0:1788845867.874129:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.874157:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.874367:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702320128 00000100:00100000:1.0:1788845867.874373:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702320128 00000100:00100000:1.0:1788845867.874400:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788845867.874408:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702320128:12345-0@lo:101: 00010000:00010000:1.0:1788845867.874417:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845867.874428:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827188a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.874446:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827188a expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.874455:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827188a expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.874462:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4536e7c00, rc 0) 00000100:00100000:1.0:1788845867.874493:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702320128:12345-0@lo:101: Request processed in 87us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.874499:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788845867.874714:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702320128:0@lo:101: 00010000:00010000:0.0:1788845867.874726:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.874734:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.874785:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702320256:0@lo:501: 00000100:00100000:0.0:1788845867.874809:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.874896:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.877043:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702320256 00000100:00100000:1.0:1788845867.877055:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702320256 00000100:00100000:1.0:1788845867.877164:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788845867.877174:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702320256:12345-0@lo:501: 00000100:00100000:1.0:1788845867.877331:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702320256:12345-0@lo:501: Request processed in 158us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.877339:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788845867.883291:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702320256:0@lo:501: 00000100:00100000:2.0:1788845867.883354:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702320384:0@lo:503: 00000100:00100000:2.0:1788845867.883430:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845867.883472:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845867.883494:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702320384 00000100:00100000:2.0:1788845867.883501:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702320384 00000100:00100000:2.0:1788845867.883575:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788845867.883584:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702320384:12345-0@lo:503: 00000100:00100000:2.0:1788845867.886020:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702320384:12345-0@lo:503: Request processed in 2430us (2583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845867.886032:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788845867.889765:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702320384:0@lo:503: 00000100:00100000:0.0:1788845867.890283:0:9817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9817:1875740702320512:0@lo:502: 00000100:00100000:0.0:1788845867.890351:0:9817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.890416:0:9817:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.893874:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702320512 00000100:00100000:1.0:1788845867.893888:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702320512 00000100:00100000:1.0:1788845867.894030:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788845867.894040:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:9817:x1875740702320512:12345-0@lo:502: 00000100:00100000:1.0:1788845867.894214:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:9817:x1875740702320512:12345-0@lo:502: Request processed in 175us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.894221:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788845867.894324:0:9817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9817:1875740702320512:0@lo:502: 00000020:01000000:0.0:1788845867.894357:0:9817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788845867.894364:0:9817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788845867.894372:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845867.894374:0:9817:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788845867.894379:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788845867.894383:0:9817:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:0.0:1788845867.894406:0:9817:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788845867.894409:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788845867.894432:0:9817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90e34387b370) 00000020:00000080:0.0:1788845867.894455:0:9817:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788845867.894462:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788845867.894581:0:9817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788845867.894587:0:9817:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788845867.894594:0:9817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d5613827189f 00010000:00080000:0.0:1788845867.894631:0:9817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e3424f7000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788845867.894851:0:9817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788845867.895156:0:9817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788845867.895167:0:9817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788845867.895319:0:9817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845867.895423:0:9817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845867.895575:0:9817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788845867.895732:0:9817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788845867.896186:0:9818:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788845867.896190:0:9818:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788845867.901658:0:9817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788845867.901679:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788845867.901728:0:9817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788845867.901753:0:9817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382718a6 00000100:00080000:0.0:1788845867.901763:0:9817:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788845867.901769:0:9817:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e3424f7000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788845867.901803:0:9817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b3800 x1875740702320640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788845867.901829:0:9817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788845867.901876:0:9817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845867.901880:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845867.901882:0:9817:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788845867.901885:0:9817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845867.901888:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845867.901890:0:9817:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788845867.901893:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788845867.901895:0:9817:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788845867.902051:0:9817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9817:1875740702320768:0@lo:502: 00000100:00100000:0.0:1788845867.902137:0:9817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.902173:0:9817:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45a29a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.902701:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702320640:0@lo:8: 00000100:00100000:0.0:1788845867.902738:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.903002:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702320640 00000100:00100000:1.0:1788845867.903010:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702320640 00000100:00100000:1.0:1788845867.903049:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788845867.903056:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702320640:12345-0@lo:8: 00010000:00080000:1.0:1788845867.903084:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1788845867.903118:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d561382718ad 00002000:00100000:1.0:1788845867.903132:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90e47f429000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788845867.903136:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788845867.903140:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788845867.903201:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788845867.903437:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788845867.903460:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e47f42d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845867.903552:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702320640:12345-0@lo:8: Request processed in 495us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.903560:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788845867.903778:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b3800 x1875740702320640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845867.903789:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788845867.903795:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788845867.903802:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788845867.903808:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788845867.903810:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e3424f7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788845867.903824:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788845867.903831:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702320640:0@lo:8: 00000004:00080000:0.0:1788845867.903996:0:9818:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788845867.904047:0:9818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 251941526471ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788845867.904054:0:9818:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788845867.904442:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9819:1875740702320896:0@lo:700: 00000100:00100000:1.0:1788845867.904485:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.904517:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80300 going to sleep for 11 seconds 00000100:00100000:3.0:1788845867.904599:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702320896 00000100:00100000:3.0:1788845867.904611:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702320896 00000100:00100000:2.0:1788845867.905196:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702320768 00000100:00100000:2.0:1788845867.905203:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702320768 00000100:00100000:2.0:1788845867.905238:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788845867.905247:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:9817:x1875740702320768:12345-0@lo:502: 00000100:00100000:2.0:1788845867.905378:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:9817:x1875740702320768:12345-0@lo:502: Request processed in 133us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845867.905386:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788845867.905728:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788845867.905738:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9819:x1875740702320896:12345-0@lo:700: 00000100:00100000:3.0:1788845867.905778:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8440:1875740702321024:0@lo:700: 00000100:00100000:3.0:1788845867.906600:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.906644:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427fe300 going to sleep for 11 seconds 00000100:00080000:3.0:1788845867.906661:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845867.907027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702321024 00000100:00100000:1.0:1788845867.907046:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702321024 00000100:00100000:1.0:1788845867.907158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788845867.907167:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8440:x1875740702321024:12345-0@lo:700: 00000004:00080000:0.0:1788845867.908005:0:7446:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788845867.908136:0:9817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9817:1875740702320768:0@lo:502: 00000020:01000000:0.0:1788845867.908174:0:9817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845867.908181:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845867.908184:0:9817:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788845867.908193:0:9817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1788845867.908258:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788845867.908278:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788845867.908287:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.908297:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845867.908307:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788845867.908310:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e451417000 from 39 10000000:01000000:0.0:1788845867.908313:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845867.908837:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.908846:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.908855:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.908874:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321152:0@lo:101: 00000100:00100000:0.0:1788845867.909653:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.911031:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45a29a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.912204:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702321152 00000100:00100000:1.0:1788845867.912215:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702321152 00000100:00100000:1.0:1788845867.912265:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788845867.912327:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702321152:12345-0@lo:101: 00010000:00010000:1.0:1788845867.912342:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845867.912358:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382718b4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.912385:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382718b4 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.912395:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382718b4 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.912404:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4536e6400, rc 0) 00000100:00100000:1.0:1788845867.912471:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702321152:12345-0@lo:101: Request processed in 147us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.912478:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788845867.912764:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321152:0@lo:101: 00010000:00010000:0.0:1788845867.912781:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.912793:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.912876:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321280:0@lo:501: 00000100:00100000:0.0:1788845867.912982:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.913018:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45a29a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.914004:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702321280 00000100:00100000:1.0:1788845867.914012:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702321280 00000100:00100000:1.0:1788845867.914051:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788845867.914134:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702321280:12345-0@lo:501: 00000100:00100000:1.0:1788845867.914261:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702321280:12345-0@lo:501: Request processed in 202us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.914268:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788845867.914426:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321280:0@lo:501: 00000100:00100000:0.0:1788845867.914461:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321408:0@lo:503: 00000100:00100000:0.0:1788845867.914506:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.915170:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45a29a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.915187:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702321408 00000100:00100000:0.0:1788845867.915192:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702321408 00000100:00100000:0.0:1788845867.915222:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788845867.915229:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702321408:12345-0@lo:503: 00000100:00100000:0.0:1788845867.915315:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702321408:12345-0@lo:503: Request processed in 85us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.915322:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788845867.915368:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321408:0@lo:503: 00000100:00100000:3.0:1788845867.918724:0:9820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9820:1875740702321536:0@lo:502: 00000100:00100000:3.0:1788845867.918797:0:9820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.919019:0:9820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427fe000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.919241:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702321536 00000100:00100000:0.0:1788845867.919250:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702321536 00000100:00100000:0.0:1788845867.919324:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788845867.919335:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:9820:x1875740702321536:12345-0@lo:502: 00000100:00100000:0.0:1788845867.919454:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:9820:x1875740702321536:12345-0@lo:502: Request processed in 121us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.919462:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788845867.919607:0:9820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9820:1875740702321536:0@lo:502: 00000100:00100000:3.0:1788845867.919657:0:9820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9820:1875740702321664:0@lo:502: 00000100:00100000:3.0:1788845867.919693:0:9820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.919854:0:9820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427fe000 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.919891:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702321664 00000100:00100000:1.0:1788845867.919896:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702321664 00000100:00100000:1.0:1788845867.919980:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788845867.919988:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:9820:x1875740702321664:12345-0@lo:502: 00000100:00100000:3.0:1788845867.920225:0:9820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9820:1875740702321664:0@lo:502: 00000040:00080000:3.0:1788845867.920246:0:9820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:1.0:1788845867.920680:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:9820:x1875740702321664:12345-0@lo:502: Request processed in 692us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.920688:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000020:01000000:0.0:1788845867.920795:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788845867.920819:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845867.920835:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.920846:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845867.920856:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788845867.920858:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e451417000 from 6 10000000:01000000:0.0:1788845867.920861:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788845867.920892:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.920900:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.920982:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.920998:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321792:0@lo:101: 00000100:00100000:0.0:1788845867.921037:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.921109:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45a29a3c0 going to sleep for 11 seconds 40000000:02000000:0.0:1788845867.921130:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788845867.926205:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702321792 00000100:00100000:1.0:1788845867.926220:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702321792 00000100:00100000:1.0:1788845867.926287:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788845867.926298:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702321792:12345-0@lo:101: 00010000:00010000:1.0:1788845867.926315:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845867.926332:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4536e7e00/0x21b4d561382718c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382718c2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.926359:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e7e00/0x21b4d561382718c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382718c2 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.926369:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4536e7e00/0x21b4d561382718c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382718c2 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.926378:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4536e7e00, rc 0) 00000100:00100000:1.0:1788845867.926448:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702321792:12345-0@lo:101: Request processed in 152us (5409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.926455:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788845867.931407:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321792:0@lo:101: 00010000:00010000:0.0:1788845867.931434:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.931446:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.931516:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321920:0@lo:256: 00000100:00100000:0.0:1788845867.931610:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.931644:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45a29a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.931822:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702321920 00000100:00100000:0.0:1788845867.931831:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702321920 00000100:00100000:0.0:1788845867.931874:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788845867.931882:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702321920:12345-0@lo:256: 20000000:01000000:0.0:1788845867.931900:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00100000:1.0:1788845867.933228:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8440:x1875740702321024:12345-0@lo:700: Request processed in 26056us (26623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.933241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788845867.934214:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a52d80 x1875740702321024/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845867.934230:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8440:1875740702321024:0@lo:700: 40000000:02000000:3.0:1788845867.934242:0:8440:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 20000000:01000000:0.0:1788845867.935152:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788845867.935158:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788845867.935290:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702321920:12345-0@lo:256: Request processed in 3407us (3678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.935300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788845867.936403:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702321920:0@lo:256: 10000000:01000000:1.0:1788845867.936475:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788845867.936485:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.936495:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845867.936503:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788845867.936505:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788845867.936508:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788845867.936580:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.936588:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.936596:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845867.936613:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322048:0@lo:101: 00000100:00100000:1.0:1788845867.936656:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.936690:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788845867.936708:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702322048 00000100:00100000:1.0:1788845867.936713:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702322048 00000100:00100000:1.0:1788845867.936749:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788845867.936758:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702322048:12345-0@lo:101: 00010000:00010000:1.0:1788845867.936770:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845867.936781:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382718d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.936811:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382718d0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.936822:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382718d0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.936831:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e4536e6600, rc 0) 00000100:00100000:1.0:1788845867.936864:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702322048:12345-0@lo:101: Request processed in 107us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.936870:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788845867.938162:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322048:0@lo:101: 00010000:00010000:1.0:1788845867.938180:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845867.938191:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845867.938254:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322176:0@lo:501: 00000100:00100000:1.0:1788845867.938296:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845867.938321:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.939140:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702322176 00000100:00100000:0.0:1788845867.939148:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702322176 00000100:00100000:0.0:1788845867.939187:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788845867.939195:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702322176:12345-0@lo:501: 00000100:00100000:0.0:1788845867.939329:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702322176:12345-0@lo:501: Request processed in 134us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.939336:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788845867.939378:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322176:0@lo:501: 00000100:00100000:0.0:1788845867.939412:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322304:0@lo:503: 00000100:00100000:0.0:1788845867.939453:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.939473:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.939484:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702322304 00000100:00100000:0.0:1788845867.939488:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702322304 00000100:00100000:0.0:1788845867.939508:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788845867.939515:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702322304:12345-0@lo:503: 00000100:00100000:0.0:1788845867.939613:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702322304:12345-0@lo:503: Request processed in 99us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.939620:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788845867.939657:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322304:0@lo:503: 00000100:00100000:0.0:1788845867.941229:0:9821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9821:1875740702322432:0@lo:502: 00000100:00100000:0.0:1788845867.941294:0:9821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.941325:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702322432 00000100:00100000:0.0:1788845867.941331:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702322432 00000100:00100000:0.0:1788845867.941366:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788845867.941373:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:9821:x1875740702322432:12345-0@lo:502: 00000100:00100000:0.0:1788845867.941472:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:9821:x1875740702322432:12345-0@lo:502: Request processed in 98us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.941479:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788845867.941540:0:9821:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.941558:0:9821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9821:1875740702322432:0@lo:502: 00000020:01000000:0.0:1788845867.941587:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788845867.941594:0:9821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788845867.941600:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845867.941602:0:9821:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788845867.941607:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788845867.941611:0:9821:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:0.0:1788845867.941631:0:9821:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788845867.941633:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788845867.941646:0:9821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90e3438799b8) 00000020:00000080:0.0:1788845867.941668:0:9821:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788845867.941672:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788845867.941750:0:9821:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788845867.941760:0:9821:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788845867.941766:0:9821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d561382718e5 00010000:00080000:0.0:1788845867.941792:0:9821:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e3438b2800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788845867.945388:0:9821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788845867.945563:0:9821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788845867.945577:0:9821:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788845867.945773:0:9821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845867.945902:0:9821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788845867.946889:0:9821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788845867.946998:0:9821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788845867.948830:0:9822:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788845867.948836:0:9822:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788845867.950961:0:9821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788845867.950975:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788845867.951015:0:9821:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788845867.951039:0:9821:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382718ec 00000100:00080000:2.0:1788845867.951050:0:9821:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788845867.951055:0:9821:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e3438b2800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788845867.951109:0:9821:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e4437a4380 x1875740702322560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788845867.951133:0:9821:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788845867.951187:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845867.951192:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845867.951194:0:9821:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788845867.951197:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845867.951201:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845867.951202:0:9821:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788845867.951205:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788845867.951207:0:9821:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788845867.951232:0:9821:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9821:1875740702322688:0@lo:502: 00000100:00100000:2.0:1788845867.951302:0:9821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.951977:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702322560:0@lo:8: 00000001:00100000:0.0:1788845867.952718:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788845867.952930:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702322688 00000100:00100000:3.0:1788845867.952938:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845867.952938:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702322688 00000100:00100000:2.0:1788845867.952975:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788845867.952984:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:9821:x1875740702322688:12345-0@lo:502: 00000100:00100000:2.0:1788845867.953107:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:9821:x1875740702322688:12345-0@lo:502: Request processed in 123us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845867.953114:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788845867.953163:0:9821:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e709c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845867.953183:0:9821:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:9821:1875740702322688:0@lo:502: 00000020:01000000:2.0:1788845867.953212:0:9821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845867.953218:0:9821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845867.953220:0:9821:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788845867.953225:0:9821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:2.0:1788845867.953708:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702322560 00000100:00100000:2.0:1788845867.953714:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702322560 00000100:00100000:2.0:1788845867.953740:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788845867.953753:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702322560:12345-0@lo:8: 00010000:00080000:2.0:1788845867.953779:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1788845867.953804:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d561382718f3 00002000:00100000:2.0:1788845867.953817:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90e343779800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788845867.953821:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788845867.953823:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788845867.953890:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788845867.953913:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90e34377f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845867.953967:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702322560:12345-0@lo:8: Request processed in 213us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845867.953973:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788845867.954113:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a4380 x1875740702322560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788845877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845867.954124:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788845867.954139:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788845867.954145:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788845867.954150:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788845867.954152:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e3438b2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788845867.954169:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788845867.954174:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702322560:0@lo:8: 00000004:00080000:2.0:1788845867.954194:0:9822:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788845867.954246:0:9822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 251991725172ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788845867.954252:0:9822:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788845867.957616:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9819:x1875740702320896:12345-0@lo:700: Request processed in 51870us (53120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.957630:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1788845867.957665:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788845867.957702:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788845867.957713:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.957725:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845867.957735:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788845867.957738:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90e450c6cd28 from 1 10000000:01000000:0.0:1788845867.957740:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788845867.957771:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.957778:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.957801:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.957821:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322816:0@lo:101: 00000100:00100000:0.0:1788845867.957862:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.957891:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.957908:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702322816 00000100:00100000:0.0:1788845867.957914:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702322816 00000100:00100000:0.0:1788845867.957957:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788845867.957967:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702322816:12345-0@lo:101: 00010000:00010000:0.0:1788845867.957978:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845867.957990:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382718fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.958013:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382718fa expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.958023:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382718fa expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.958032:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0d800, rc 0) 00000100:00100000:0.0:1788845867.958074:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702322816:12345-0@lo:101: Request processed in 109us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845867.958081:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788845867.958130:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322816:0@lo:101: 00010000:00010000:0.0:1788845867.958142:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.958162:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845867.958217:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322944:0@lo:501: 00000100:00100000:0.0:1788845867.958245:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.958264:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845867.958279:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702322944 00000100:00100000:0.0:1788845867.958283:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702322944 00000100:00100000:0.0:1788845867.958306:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788845867.958312:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702322944:12345-0@lo:501: 00000100:00100000:0.0:1788845867.958379:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702322944:12345-0@lo:501: Request processed in 66us (132us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845867.958386:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788845867.958415:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702322944:0@lo:501: 10000000:01000000:0.0:1788845867.958438:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788845867.958443:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845867.958451:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788845867.958650:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c13100 x1875740702320896/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845867.958663:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9819:1875740702320896:0@lo:700: 00000004:00080000:3.0:1788845867.958897:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788845867.959031:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845867.959043:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702323072:0@lo:13: 00000100:00100000:3.0:1788845867.959077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.959124:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702323072 00000100:00100000:3.0:1788845867.959131:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702323072 00000100:00100000:3.0:1788845867.959171:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845867.959177:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702323072:12345-0@lo:13: 00002000:00000024:3.0:1788845867.959250:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788845867.959297:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702323072:12345-0@lo:13: Request processed in 119us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845867.959308:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788845867.959325:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788845867.959335:0:9823:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788845867.959353:0:9823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1875740702323200:0@lo:7: 00000100:00100000:3.0:1788845867.959378:0:9823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.959430:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702323200 00000100:00100000:3.0:1788845867.959434:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702323200 00010000:00080000:0.0:1788845867.959500:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a50700 x1875740702323072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.959515:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702323072:0@lo:13: 00000100:00100000:3.0:1788845867.959592:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788845867.959600:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9823:x1875740702323200:12345-0@lo:7: 00000100:00100000:2.0:1788845867.963279:0:9823:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427fe300 going to sleep for 11 seconds 00000004:00080000:2.0:1788845867.968313:0:9819:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788845867.968343:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9819:1875740702323456:0@lo:7: 00000100:00100000:2.0:1788845867.968410:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845867.968452:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e709c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845867.968467:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845867.968479:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702323328:0@lo:13: 00000100:00100000:2.0:1788845867.968508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845867.968670:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702323456 00000100:00100000:3.0:1788845867.968686:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702323456 00000100:00100000:3.0:1788845867.968735:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845867.968745:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9819:x1875740702323456:12345-0@lo:7: 00000100:00100000:3.0:1788845867.968813:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702323328 00000100:00100000:3.0:1788845867.968817:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702323328 00000100:00100000:3.0:1788845867.968841:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788845867.968848:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875740702323328:12345-0@lo:13: 00002000:00000024:3.0:1788845867.968861:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788845867.968909:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1875740702323328:12345-0@lo:13: Request processed in 60us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845867.968916:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788845867.968953:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a7b80 x1875740702323328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845867.968971:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702323328:0@lo:13: 00002000:00080000:2.0:1788845867.974726:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788845867.974734:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788845867.974823:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9823:x1875740702323200:12345-0@lo:7: Request processed in 15219us (15439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845867.974833:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788845867.974900:0:9823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a52a00 x1875740702323200/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845867.974914:0:9823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a52a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1875740702323200:0@lo:7: 00000004:00080000:2.0:1788845867.974927:0:9823:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788845867.974965:0:9823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1875740702323584:0@lo:5: 00000100:00100000:2.0:1788845867.975000:0:9823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845867.975020:0:9823:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70e40 going to sleep for 11 seconds 00002000:00080000:3.0:1788845867.975286:0:8906:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788845867.975291:0:8906:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788845867.975337:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9819:x1875740702323456:12345-0@lo:7: Request processed in 6593us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845867.975344:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788845867.975359:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702323584 00000100:00100000:3.0:1788845867.975365:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702323584 00000100:00100000:3.0:1788845867.975398:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845867.975406:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9823:x1875740702323584:12345-0@lo:5: 00002000:00080000:3.0:1788845867.975430:0:8906:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788845867.975433:0:8906:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:2.0:1788845867.976251:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a7100 x1875740702323456/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845867.976265:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9819:1875740702323456:0@lo:7: 00000004:00080000:2.0:1788845867.976276:0:9819:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788845867.976306:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9819:1875740702323712:0@lo:5: 00000100:00100000:2.0:1788845867.976343:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845867.976364:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e709c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845867.976379:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702323712 00000100:00100000:2.0:1788845867.976383:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702323712 00000100:00100000:2.0:1788845867.976424:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845867.976432:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9819:x1875740702323712:12345-0@lo:5: 00002000:00080000:2.0:1788845867.976450:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788845867.976484:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9819:x1875740702323712:12345-0@lo:5: Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845867.976491:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788845867.976515:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3e9500 x1875740702323712/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845867.976541:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9819:1875740702323712:0@lo:5: 00000004:00080000:2.0:1788845867.976550:0:9819:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788845867.976579:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9819:1875740702323840:0@lo:5: 00000100:00100000:2.0:1788845867.976602:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845867.976616:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e709c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845867.976627:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702323840 00000100:00100000:2.0:1788845867.976630:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702323840 00000100:00100000:2.0:1788845867.976647:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845867.976653:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9819:x1875740702323840:12345-0@lo:5: 00002000:00080000:2.0:1788845867.976671:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1788845867.980935:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9819:x1875740702323840:12345-0@lo:5: Request processed in 4276us (4325us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788845867.980946:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788845867.981129:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3e9500 x1875740702323840/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845867.981154:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9819:1875740702323840:0@lo:5: 00000004:00080000:0.0:1788845867.981168:0:9819:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788845867.981207:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9819:1875740702323968:0@lo:900: 00000100:00100000:0.0:1788845867.981245:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845867.981275:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788845867.981566:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702323968 00000100:00100000:3.0:1788845867.981572:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702323968 00000100:00100000:3.0:1788845867.981610:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845867.981619:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9819:x1875740702323968:12345-0@lo:900: 00000100:00100000:3.0:1788845867.981666:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9819:x1875740702323968:12345-0@lo:900: Request processed in 48us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845867.981673:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788845867.981699:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b3100 x1875740702323968/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845867.981708:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9819:1875740702323968:0@lo:900: 00000001:00080000:2.0:1788845867.982888:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788845867.982906:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788845867.983037:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9823:x1875740702323584:12345-0@lo:5: Request processed in 7630us (8035us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788845867.983045:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788845867.983172:0:9823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a7b80 x1875740702323584/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845867.983183:0:9823:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788845867.983188:0:9823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1875740702323584:0@lo:5: 00000004:00080000:2.0:1788845867.983198:0:9823:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788845867.983235:0:9823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1875740702324096:0@lo:700: 00000100:00100000:2.0:1788845867.983267:0:9823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845867.983294:0:9823:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845867.983341:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702324096 00000100:00100000:3.0:1788845867.983347:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702324096 00000100:00100000:3.0:1788845867.983389:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788845867.983397:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9823:x1875740702324096:12345-0@lo:700: 00000001:00080000:3.0:1788845867.997542:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788845867.998040:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9823:x1875740702324096:12345-0@lo:700: Request processed in 14639us (14767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845867.998052:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788845867.998187:0:9823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a7b80 x1875740702324096/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788845883 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845867.998203:0:9823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1875740702324096:0@lo:700: 00000004:02000040:0.0:1788845867.999334:0:9823:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1788845868.007123:0:9823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1875740702324224:0@lo:5: 00000100:00100000:0.0:1788845868.007189:0:9823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845868.007237:0:9823:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3480 going to sleep for 11 seconds 00000100:00100000:1.0:1788845868.007362:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702324224 00000100:00100000:1.0:1788845868.007370:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702324224 00000100:00100000:1.0:1788845868.007425:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845868.007434:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9823:x1875740702324224:12345-0@lo:5: 00002000:00080000:2.0:1788845868.014631:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788845868.014650:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788845868.023925:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9823:x1875740702324224:12345-0@lo:5: Request processed in 16487us (16730us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788845868.023938:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788845868.024048:0:9823:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b0000 x1875740702324224/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788845884 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845868.024151:0:9823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9823:1875740702324224:0@lo:5: 00000004:00080000:0.0:1788845868.024168:0:9823:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:0.0:1788845868.701260:0:9879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788845868.862194:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788845869.729069:0:9931:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788845869.729303:0:9931:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788845869.886824:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845869.887856:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702324352:0@lo:41: 00000100:00100000:1.0:1788845869.887924:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845869.888014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702324352 00000100:00100000:2.0:1788845869.888021:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702324352 00000100:00100000:2.0:1788845869.888092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788845869.888101:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702324352:12345-0@lo:41: 00000004:00000024:2.0:1788845869.888131:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845869.895636:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702324352:12345-0@lo:41: Request processed in 7526us (7701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845869.895651:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788845869.908474:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702324352:0@lo:41: 00000001:00080000:3.0:1788845870.759171:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1788845870.905708:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845871.934253:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845872.442198:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702324608:0@lo:13: 00000100:00100000:0.0:1788845872.442304:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845872.442454:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845872.442474:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702324480:0@lo:13: 00000100:00100000:1.0:1788845872.442516:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845872.442746:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702324608 00000100:00100000:1.0:1788845872.442757:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702324608 00000100:00100000:1.0:1788845872.442818:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702324480 00000100:00100000:1.0:1788845872.442821:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702324480 00000100:00100000:1.0:1788845872.442845:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788845872.442855:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702324608:12345-0@lo:13: 00002000:00000024:1.0:1788845872.442891:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788845872.443143:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845872.443178:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702324608:12345-0@lo:13: Request processed in 323us (873us total) trans 0 rc 0/0 00010000:00080000:0.0:1788845872.443184:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c10380 x1875740702324608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845872.443187:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845872.443204:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702324608:0@lo:13: 00000100:00100000:1.0:1788845872.443210:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788845872.443216:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702324480:12345-0@lo:13: 00002000:00000024:1.0:1788845872.443227:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845872.443264:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702324480:12345-0@lo:13: Request processed in 48us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845872.443281:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788845872.443291:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1f80 x1875740702324480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845872.443304:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702324480:0@lo:13: 00000020:00000004:2.0:1788845872.813516:0:10033:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788845872.813891:0:10033:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788845872.954381:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702324736:0@lo:41: 00000100:00100000:1.0:1788845872.954473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845872.954578:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845872.954596:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702324736 00000100:00100000:1.0:1788845872.954667:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702324736 00000100:00100000:1.0:1788845872.954742:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845872.954753:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702324736:12345-0@lo:41: 00000004:00000024:1.0:1788845872.954799:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788845872.954855:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702324736:12345-0@lo:41: Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845872.954863:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845872.954927:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702324736:0@lo:41: 00000100:00100000:3.0:1788845872.956892:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702324864:0@lo:400: 00000100:00100000:3.0:1788845872.956982:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957045:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702325376:0@lo:400: 00000100:00100000:3.0:1788845872.957091:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957115:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702325888:0@lo:400: 00000100:00100000:3.0:1788845872.957143:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957172:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788845872.957178:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702324992:0@lo:400: 00000100:00100000:3.0:1788845872.957216:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957239:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702325504:0@lo:400: 00000100:00100000:3.0:1788845872.957263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957281:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702326016:0@lo:400: 00000100:00100000:3.0:1788845872.957306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957341:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702325120:0@lo:400: 00000100:00100000:3.0:1788845872.957369:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957389:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702325632:0@lo:400: 00000100:00100000:3.0:1788845872.957414:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957429:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788845872.957435:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702325248:0@lo:400: 00000100:00100000:3.0:1788845872.957461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957480:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702325760:0@lo:400: 00000100:00100000:3.0:1788845872.957506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845872.957556:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702325376 00000100:00100000:3.0:1788845872.957566:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702325376 00000100:00100000:0.0:1788845872.957881:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702324864 00000100:00100000:0.0:1788845872.957887:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702324864 00000100:00100000:0.0:1788845872.957937:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788845872.957949:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702324864:12345-0@lo:400: 00000100:00100000:0.0:1788845872.958023:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702324864:12345-0@lo:400: Request processed in 76us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845872.958032:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788845872.959750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702324992 00000100:00100000:3.0:1788845872.959762:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702324992 00000100:00100000:3.0:1788845872.959789:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702325504 00000100:00100000:3.0:1788845872.959793:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702325504 00000100:00100000:3.0:1788845872.959812:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702325120 00000100:00100000:3.0:1788845872.959825:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702325120 00000100:00100000:3.0:1788845872.959843:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702325632 00000100:00100000:3.0:1788845872.959846:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702325632 00000100:00100000:3.0:1788845872.959863:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702325760 00000100:00100000:3.0:1788845872.959866:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702325760 00000100:00100000:3.0:1788845872.959885:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788845872.959896:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702325376:12345-0@lo:400: 00000100:00100000:3.0:1788845872.959999:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702325376:12345-0@lo:400: Request processed in 106us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.960007:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788845872.960023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845872.960029:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702324992:12345-0@lo:400: 00000100:00100000:3.0:1788845872.960070:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702324992:12345-0@lo:400: Request processed in 41us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.960076:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845872.960088:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788845872.960094:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702325504:12345-0@lo:400: 00000100:00100000:3.0:1788845872.960125:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702325504:12345-0@lo:400: Request processed in 31us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.960131:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788845872.960142:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845872.960148:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702325120:12345-0@lo:400: 00000100:00100000:3.0:1788845872.960192:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702325120:12345-0@lo:400: Request processed in 44us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.960198:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845872.960210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845872.960216:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702325632:12345-0@lo:400: 00000100:00100000:3.0:1788845872.960256:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702325632:12345-0@lo:400: Request processed in 41us (2841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.960264:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845872.960276:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845872.960282:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702325760:12345-0@lo:400: 00000100:00100000:3.0:1788845872.960328:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702325760:12345-0@lo:400: Request processed in 46us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.960334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845872.960363:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702325888 00000100:00100000:3.0:1788845872.960368:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702325888 00000100:00100000:3.0:1788845872.960404:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702326016 00000100:00100000:3.0:1788845872.960408:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702326016 00000100:00100000:3.0:1788845872.960431:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845872.960438:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702325888:12345-0@lo:400: 00000100:00100000:3.0:1788845872.960473:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702325888:12345-0@lo:400: Request processed in 36us (3328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.960479:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788845872.960490:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845872.960496:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702326016:12345-0@lo:400: 00000100:00100000:3.0:1788845872.960552:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702326016:12345-0@lo:400: Request processed in 56us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.960558:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788845872.960594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702325248 00000100:00100000:3.0:1788845872.960598:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702325248 00000100:00100000:3.0:1788845872.961770:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788845872.961782:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702325248:12345-0@lo:400: 00000100:00100000:3.0:1788845872.961868:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702325248:12345-0@lo:400: Request processed in 88us (4405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845872.961883:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788845872.961913:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845872.961919:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788845872.961924:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788845872.961972:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a53800 x1875740702324992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845872.961991:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702324992:0@lo:400: 00010000:00080000:3.0:1788845872.962007:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a51880 x1875740702325504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845872.962017:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702325504:0@lo:400: 00010000:00080000:3.0:1788845872.962031:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a50000 x1875740702326016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845872.962038:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788845872.963730:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702326016:0@lo:400: 00000100:00100000:3.0:1788845872.963772:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702324864:0@lo:400: 00010000:00080000:3.0:1788845872.963795:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a52300 x1875740702325376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845872.963808:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702325376:0@lo:400: 00010000:00080000:3.0:1788845872.963823:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a50380 x1875740702325888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845872.963832:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788845872.963849:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702325888:0@lo:400: 00000100:00100000:3.0:1788845872.963916:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702325248:0@lo:400: 00010000:00080000:3.0:1788845872.963949:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a51f80 x1875740702325760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845872.963960:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702325760:0@lo:400: 00010000:00080000:3.0:1788845872.963974:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a52a00 x1875740702325120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845872.963983:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702325120:0@lo:400: 00010000:00080000:3.0:1788845872.963996:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a53480 x1875740702325632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845872.964005:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702325632:0@lo:400: 00000100:00100000:3.0:1788845873.465677:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845873.465711:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702326144:0@lo:13: 00000100:00100000:3.0:1788845873.465810:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845873.465897:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702326144 00000100:00100000:3.0:1788845873.465907:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702326144 00000100:00100000:3.0:1788845873.465973:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788845873.465983:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702326144:12345-0@lo:13: 00002000:00000024:3.0:1788845873.466018:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845873.466082:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702326144:12345-0@lo:13: Request processed in 100us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845873.466090:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788845873.466132:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d329880 x1875740702326144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845873.466153:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702326144:0@lo:13: 00000100:00100000:2.0:1788845873.466582:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845873.466597:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702326272:0@lo:13: 00000100:00100000:2.0:1788845873.466636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845873.466719:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702326272 00000100:00100000:1.0:1788845873.466725:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702326272 00000100:00100000:1.0:1788845873.466763:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788845873.466772:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702326272:12345-0@lo:13: 00002000:00000024:1.0:1788845873.466785:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845873.466835:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702326272:12345-0@lo:13: Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845873.466843:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788845873.466942:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c13480 x1875740702326272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845873.466966:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702326272:0@lo:13: 00010000:00010000:1.0:1788845873.980789:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788845874.016663:0:10081:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788845874.016678:0:10081:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788845874.655664:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845874.655871:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683403392 00000100:00100000:2.0:1788845874.655886:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683403392 00000100:00100000:2.0:1788845874.655938:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:2.0:1788845874.655948:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1875740683403392:12345-192.168.203.20@tcp:250: 00010000:00080000:2.0:1788845874.655983:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 22bfafdd-07c8-48a2-8d88-9be191aa000d@192.168.203.20@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:2.0:1788845874.656025:0:6509:0:(genops.c:1385:class_connect()) connect: client 22bfafdd-07c8-48a2-8d88-9be191aa000d, cookie 0x21b4d56138271908 00000100:00080000:2.0:1788845874.656221:0:6509:0:(import.c:65:import_set_state_nolock()) ffff90e34377a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845874.656325:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+5:2397:x1875740683403392:12345-192.168.203.20@tcp:250: Request processed in 376us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.656335:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:3.0:1788845874.672197:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845874.681502:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683403520 00000100:00100000:0.0:1788845874.681560:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683403520 00000100:00100000:0.0:1788845874.681672:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:0.0:1788845874.681686:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+5:6155:x1875740683403520:12345-192.168.203.20@tcp:101: 00010000:00010000:0.0:1788845874.681709:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845874.681733:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217543af expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845874.681771:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845874.681791:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845874.681804:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0de00, rc 0) 00000100:00100000:0.0:1788845874.682191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+6:6155:x1875740683403520:12345-192.168.203.20@tcp:101: Request processed in 507us (10009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845874.682199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:3.0:1788845874.686977:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845874.687124:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683403648 00000100:00100000:0.0:1788845874.687137:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683403648 00000100:00100000:0.0:1788845874.687209:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:0.0:1788845874.687240:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+6:6155:x1875740683403648:12345-192.168.203.20@tcp:501: 00000100:00100000:0.0:1788845874.687407:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+6:6155:x1875740683403648:12345-192.168.203.20@tcp:501: Request processed in 169us (444us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845874.687415:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:3.0:1788845874.693116:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845874.693273:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683403776 00000100:00100000:0.0:1788845874.693286:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683403776 00000100:00100000:0.0:1788845874.693364:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:0.0:1788845874.693376:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+6:6155:x1875740683403776:12345-192.168.203.20@tcp:101: 00010000:00010000:0.0:1788845874.693398:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845874.693420:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217543b6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845874.693456:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845874.693480:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845874.693492:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0d600, rc 0) 00000100:00100000:0.0:1788845874.693607:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+7:6155:x1875740683403776:12345-192.168.203.20@tcp:101: Request processed in 233us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845874.693615:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:1.0:1788845874.695736:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845874.695839:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683403904 00000100:00100000:3.0:1788845874.695852:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683403904 00000100:00100000:3.0:1788845874.695916:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:3.0:1788845874.695929:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+7:6155:x1875740683403904:12345-192.168.203.20@tcp:501: 00000100:00100000:3.0:1788845874.696152:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6155:x1875740683403904:12345-192.168.203.20@tcp:501: Request processed in 225us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845874.696160:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:3.0:1788845874.698035:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845874.698272:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683404032 00000100:00100000:2.0:1788845874.698285:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683404032 00000100:00100000:2.0:1788845874.698352:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:2.0:1788845874.698362:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6155:x1875740683404032:12345-192.168.203.20@tcp:503: 00000100:00100000:2.0:1788845874.698591:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6155:x1875740683404032:12345-192.168.203.20@tcp:503: Request processed in 229us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.698611:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:1.0:1788845874.701727:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845874.701903:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683404160 00000100:00100000:2.0:1788845874.701917:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683404160 00000100:00100000:2.0:1788845874.702037:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:2.0:1788845874.702059:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6174:x1875740683404160:12345-192.168.203.20@tcp:502: 00000100:00100000:2.0:1788845874.702280:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6174:x1875740683404160:12345-192.168.203.20@tcp:502: Request processed in 224us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.702289:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:1.0:1788845874.754914:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845874.755067:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683404288 00000100:00100000:0.0:1788845874.755082:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683404288 00000100:00100000:0.0:1788845874.755157:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:0.0:1788845874.755169:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6174:x1875740683404288:12345-192.168.203.20@tcp:502: 00000100:00100000:0.0:1788845874.755675:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6174:x1875740683404288:12345-192.168.203.20@tcp:502: Request processed in 503us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845874.755693:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:0.0:1788845874.763666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845874.763876:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683404416 00000100:00100000:2.0:1788845874.763890:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683404416 00000100:00100000:2.0:1788845874.763996:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:2.0:1788845874.764009:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6155:x1875740683404416:12345-192.168.203.20@tcp:101: 00010000:00010000:2.0:1788845874.764048:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845874.764081:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42d200/0x21b4d5613827191d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217543e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845874.764120:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d200/0x21b4d5613827191d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543e7 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845874.764133:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42d200/0x21b4d5613827191d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543e7 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845874.764144:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d200, rc 0) 00000100:00100000:2.0:1788845874.764328:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6155:x1875740683404416:12345-192.168.203.20@tcp:101: Request processed in 321us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.764337:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:1.0:1788845874.770670:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845874.777191:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683404544 00000100:00100000:3.0:1788845874.777215:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683404544 00000100:00100000:3.0:1788845874.777307:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:3.0:1788845874.777320:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6155:x1875740683404544:12345-192.168.203.20@tcp:256: 20000000:01000000:3.0:1788845874.777358:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788845874.777392:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788845874.777397:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788845874.777401:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788845874.777404:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788845874.777630:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788845874.788345:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6155:x1875740683404544:12345-192.168.203.20@tcp:256: Request processed in 11008us (17671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845874.788365:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:0.0:1788845874.791353:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845874.791621:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683404672 00000100:00100000:2.0:1788845874.791653:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683404672 00000100:00100000:2.0:1788845874.791755:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:2.0:1788845874.791768:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6155:x1875740683404672:12345-192.168.203.20@tcp:101: 00010000:00010000:2.0:1788845874.791790:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845874.791814:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217543ee expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845874.791854:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845874.791898:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845874.791910:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42ca00, rc 0) 00000100:00100000:2.0:1788845874.791994:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6155:x1875740683404672:12345-192.168.203.20@tcp:101: Request processed in 227us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.792002:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:0.0:1788845874.801840:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845874.801955:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683404800 00000100:00100000:3.0:1788845874.801969:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683404800 00000100:00100000:3.0:1788845874.802190:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:3.0:1788845874.802202:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6155:x1875740683404800:12345-192.168.203.20@tcp:501: 00000100:00100000:3.0:1788845874.802677:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6155:x1875740683404800:12345-192.168.203.20@tcp:501: Request processed in 475us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845874.802687:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:1.0:1788845874.806957:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845874.807152:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683404928 00000100:00100000:2.0:1788845874.807167:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683404928 00000100:00100000:2.0:1788845874.807297:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:2.0:1788845874.807311:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6155:x1875740683404928:12345-192.168.203.20@tcp:503: 00000100:00100000:2.0:1788845874.807871:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6155:x1875740683404928:12345-192.168.203.20@tcp:503: Request processed in 560us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.807881:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:2.0:1788845874.822948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845874.823131:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683405056 00000100:00100000:3.0:1788845874.823146:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683405056 00000100:00100000:3.0:1788845874.823212:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:3.0:1788845874.823224:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6176:x1875740683405056:12345-192.168.203.20@tcp:502: 00000100:00100000:3.0:1788845874.823460:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6176:x1875740683405056:12345-192.168.203.20@tcp:502: Request processed in 236us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845874.823476:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:3.0:1788845874.828189:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845874.828375:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683405184 00000100:00100000:2.0:1788845874.828390:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683405184 00000100:00100000:2.0:1788845874.828484:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:2.0:1788845874.828512:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6176:x1875740683405184:12345-192.168.203.20@tcp:502: 00000100:00100000:2.0:1788845874.828753:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6176:x1875740683405184:12345-192.168.203.20@tcp:502: Request processed in 242us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.828762:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:2.0:1788845874.833477:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845874.833822:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845874.840704:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683405312 00000100:00100000:0.0:1788845874.840729:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683405312 00000100:00100000:2.0:1788845874.841199:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683405568 00000100:00100000:2.0:1788845874.841206:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683405568 00000100:00100000:2.0:1788845874.841348:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788845874.841360:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875740683405312:12345-192.168.203.20@tcp:38: 00010000:00080000:2.0:1788845874.841402:0:7876:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:2.0:1788845874.841499:0:7876:0:(genops.c:1385:class_connect()) connect: client 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635, cookie 0x21b4d5613827192b 00000004:00100000:2.0:1788845874.841571:0:7876:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788845874.841875:0:7876:0:(import.c:65:import_set_state_nolock()) ffff90e4752f9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845874.841977:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2397:x1875740683405312:12345-192.168.203.20@tcp:38: Request processed in 616us (8523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.841987:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788845874.842024:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1788845874.842031:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875740683405568:12345-192.168.203.20@tcp:38: 00010000:00080000:2.0:1788845874.842060:0:7876:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:2.0:1788845874.842104:0:7876:0:(genops.c:1385:class_connect()) connect: client 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635, cookie 0x21b4d56138271932 00000004:00100000:2.0:1788845874.842120:0:7876:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788845874.842326:0:7876:0:(import.c:65:import_set_state_nolock()) ffff90e343669800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788845874.842356:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2397:x1875740683405568:12345-192.168.203.20@tcp:38: Request processed in 323us (8677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845874.842373:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00010000:00010000:2.0:1788845875.002113:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845875.002669:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845875.002701:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702326400:0@lo:41: 00000100:00100000:2.0:1788845875.002797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845875.002943:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702326400 00000100:00100000:3.0:1788845875.002953:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702326400 00000100:00100000:2.0:1788845875.003413:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788845875.003430:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702326400:12345-0@lo:41: 00000004:00000024:2.0:1788845875.003482:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845875.003603:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702326400:12345-0@lo:41: Request processed in 178us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845875.003611:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788845875.004567:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702326400:0@lo:41: 00000100:00100000:2.0:1788845875.863054:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845875.863154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683405696 00000100:00100000:3.0:1788845875.863168:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683405696 00000100:00100000:3.0:1788845875.863277:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1788845875.863291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:0:x1875740683405696:12345-192.168.203.20@tcp:41: 00000004:00000024:3.0:1788845875.863336:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788845875.863432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:0:x1875740683405696:12345-192.168.203.20@tcp:41: Request processed in 144us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845875.863440:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00080000:2.0:1788845875.863877:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845875.866372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845875.867832:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683405440 00000100:00100000:1.0:1788845875.867851:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683405440 00000100:00100000:1.0:1788845875.867962:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1788845875.867974:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:0:x1875740683405440:12345-192.168.203.20@tcp:41: 00000004:00000024:1.0:1788845875.868024:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788845875.868145:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:0:x1875740683405440:12345-192.168.203.20@tcp:41: Request processed in 173us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845875.868154:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00080000:2.0:1788845875.868315:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845875.868982:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845875.876783:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683405824 00000100:00100000:0.0:1788845875.876805:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683405824 00000100:00100000:0.0:1788845875.876911:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1788845875.876924:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6155:x1875740683405824:12345-192.168.203.20@tcp:41: 00000004:00000024:0.0:1788845875.876970:0:7876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788845875.878835:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6155:x1875740683405824:12345-192.168.203.20@tcp:41: Request processed in 1899us (9842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845875.878850:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1788845875.884820:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845875.885011:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683405952 00000100:00100000:1.0:1788845875.885026:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683405952 00000100:00100000:1.0:1788845875.885116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1788845875.885128:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6155:x1875740683405952:12345-192.168.203.20@tcp:40: 00000100:00100000:1.0:1788845875.885260:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6155:x1875740683405952:12345-192.168.203.20@tcp:40: Request processed in 134us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845875.885269:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1788845875.890901:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845875.890945:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845875.890976:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845875.891011:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845875.891179:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683406080 00000100:00100000:1.0:1788845875.891193:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683406080 00000100:00100000:1.0:1788845875.891239:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683406208 00000100:00100000:1.0:1788845875.891241:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683406208 00000100:00100000:1.0:1788845875.891263:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1788845875.891273:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875740683406080:12345-192.168.203.20@tcp:8: 00010000:00080000:1.0:1788845875.891314:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1788845875.891357:0:8430:0:(genops.c:1385:class_connect()) connect: client 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635, cookie 0x21b4d56138271939 00002000:00100000:1.0:1788845875.891387:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635/ffff90e4437d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788845875.891408:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845875.891688:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788845875.891726:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e47f428000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845875.891806:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2397:x1875740683406080:12345-192.168.203.20@tcp:8: Request processed in 533us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845875.891814:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1788845875.891839:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1788845875.891844:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875740683406208:12345-192.168.203.20@tcp:8: 00010000:00080000:1.0:1788845875.891862:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1788845875.891880:0:8430:0:(genops.c:1385:class_connect()) connect: client 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635, cookie 0x21b4d56138271940 00002000:00100000:1.0:1788845875.891885:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635/ffff90e47f428800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788845875.891895:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788845875.892005:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788845875.892019:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e47f42d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788845875.892051:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2397:x1875740683406208:12345-192.168.203.20@tcp:8: Request processed in 206us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845875.892057:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1788845875.892367:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683406464 00000100:00100000:2.0:1788845875.892375:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683406464 00000100:00100000:2.0:1788845875.892427:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:2.0:1788845875.892435:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683406464:12345-192.168.203.20@tcp:400: 00000100:00100000:2.0:1788845875.892483:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683406464:12345-192.168.203.20@tcp:400: Request processed in 49us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845875.892489:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:0.0:1788845875.893112:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683406336 00000100:00100000:0.0:1788845875.893121:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683406336 00000100:00100000:0.0:1788845875.893171:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1788845875.893180:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6155:x1875740683406336:12345-192.168.203.20@tcp:900: 00000100:00100000:0.0:1788845875.893259:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6155:x1875740683406336:12345-192.168.203.20@tcp:900: Request processed in 80us (2369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845875.893267:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:1.0:1788845875.904718:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845875.904882:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683406592 00000100:00100000:3.0:1788845875.904896:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683406592 00000100:00100000:3.0:1788845875.904974:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788845875.904987:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6155:x1875740683406592:12345-192.168.203.20@tcp:33: 00000004:00080000:3.0:1788845875.930707:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25595us 00000004:00200000:3.0:1788845875.989899:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788845875.990102:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6155:x1875740683406592:12345-192.168.203.20@tcp:33: Request processed in 85110us (85390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845875.990116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00010000:00010000:1.0:1788845876.025803:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845876.254239:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845876.254750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683406720 00000100:00100000:1.0:1788845876.254765:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683406720 00000100:00100000:1.0:1788845876.254845:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:1.0:1788845876.254858:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6194:x1875740683406720:12345-192.168.203.20@tcp:101: 00010000:00010000:1.0:1788845876.254885:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845876.258244:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175441f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845876.258329:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d5613827194e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845876.258342:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d5613827194e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845876.258359:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d5613827194e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845876.258408:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788845876.258412:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788845876.258428:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d5613827194e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845876.258457:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175441f expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845876.258476:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d5613827194e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175441f expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845876.258485:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342864000) 00010000:00010000:1.0:1788845876.258488:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845876.258491:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3800, rc 0) 00000100:00100000:1.0:1788845876.258620:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:6194:x1875740683406720:12345-192.168.203.20@tcp:101: Request processed in 3764us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845876.258629:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00010000:00010000:1.0:1788845877.050259:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845877.562308:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845877.563683:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845877.563718:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702326656:0@lo:13: 00000100:00100000:0.0:1788845877.563801:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845877.567048:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702326528:0@lo:13: 00000100:00100000:3.0:1788845877.567129:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845877.575381:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702326656 00000100:00100000:1.0:1788845877.575397:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702326656 00000100:00100000:1.0:1788845877.575474:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702326528 00000100:00100000:1.0:1788845877.575478:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702326528 00000100:00100000:1.0:1788845877.575502:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788845877.575510:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702326656:12345-0@lo:13: 00002000:00000024:1.0:1788845877.575557:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845877.575635:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702326656:12345-0@lo:13: Request processed in 125us (11832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845877.575643:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788845877.575664:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845877.575671:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702326528:12345-0@lo:13: 00002000:00000024:1.0:1788845877.575680:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845877.575725:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702326528:12345-0@lo:13: Request processed in 55us (8597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845877.575732:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788845877.575783:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1f80 x1875740702326528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845877.575804:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702326528:0@lo:13: 00010000:00080000:0.0:1788845877.576492:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c11180 x1875740702326656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845877.576553:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702326656:0@lo:13: 00000100:00080000:3.0:1788845877.578323:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845878.073946:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702327040:0@lo:400: 00000100:00100000:1.0:1788845878.073946:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702326912:0@lo:400: 00000100:00100000:3.0:1788845878.074025:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702327168:0@lo:400: 00000100:00100000:0.0:1788845878.074067:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702326784:0@lo:400: 00000100:00100000:2.0:1788845878.074191:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.074244:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702327552:0@lo:400: 00000100:00100000:2.0:1788845878.074277:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.074575:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702328064:0@lo:400: 00000100:00100000:2.0:1788845878.074599:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.074639:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702327552 00000100:00100000:2.0:1788845878.074646:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702327552 00000100:00100000:2.0:1788845878.074698:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702328064 00000100:00100000:2.0:1788845878.074701:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702328064 00000100:00100000:2.0:1788845878.074723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788845878.074731:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702327552:12345-0@lo:400: 00000100:00100000:2.0:1788845878.074790:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702327552:12345-0@lo:400: Request processed in 59us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.074799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788845878.075292:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788845878.075300:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702328064:12345-0@lo:400: 00000100:00100000:2.0:1788845878.075332:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702328064:12345-0@lo:400: Request processed in 34us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.075338:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788845878.075354:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788845878.075382:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c13480 x1875740702327552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845878.075395:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702327552:0@lo:400: 00010000:00080000:2.0:1788845878.075404:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c13800 x1875740702328064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845878.075412:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702328064:0@lo:400: 00000100:00100000:2.0:1788845878.075458:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702327040 00000100:00100000:2.0:1788845878.075462:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702327040 00000100:00100000:2.0:1788845878.075487:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788845878.075492:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702327040:12345-0@lo:400: 00000100:00100000:2.0:1788845878.075553:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702327040:12345-0@lo:400: Request processed in 60us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.075559:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788845878.075584:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702327040:0@lo:400: 00000100:00100000:3.0:1788845878.078863:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845878.078921:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702327680:0@lo:400: 00000100:00100000:3.0:1788845878.078957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845878.079053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845878.079081:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702327424:0@lo:400: 00000100:00100000:1.0:1788845878.079106:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845878.079138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845878.079147:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702327936:0@lo:400: 00000100:00100000:0.0:1788845878.079172:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702327296:0@lo:400: 00000100:00100000:1.0:1788845878.079207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845878.079212:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845878.079230:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702328448:0@lo:41: 00000100:00100000:0.0:1788845878.079240:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702327808:0@lo:400: 00000100:00100000:1.0:1788845878.079274:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845878.079347:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845878.079347:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702326784 00000100:00100000:0.0:1788845878.079356:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702326784 00000100:00100000:1.0:1788845878.079358:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702327168 00000100:00100000:1.0:1788845878.079363:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702327168 00000100:00100000:1.0:1788845878.079396:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702326912 00000100:00100000:1.0:1788845878.079399:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702326912 00000100:00100000:0.0:1788845878.079408:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788845878.079414:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702327424 00000100:00100000:1.0:1788845878.079417:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702327424 00000100:00100000:0.0:1788845878.079419:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702326784:12345-0@lo:400: 00000100:00100000:1.0:1788845878.079445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702327936 00000100:00100000:1.0:1788845878.079448:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702327936 00000100:00100000:0.0:1788845878.079475:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702326784:12345-0@lo:400: Request processed in 58us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845878.079482:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788845878.079484:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788845878.079493:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702327168:12345-0@lo:400: 00000100:00100000:0.0:1788845878.079540:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702327296 00000100:00100000:0.0:1788845878.079545:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702327296 00000100:00100000:1.0:1788845878.079560:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702327168:12345-0@lo:400: Request processed in 68us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845878.079568:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788845878.079571:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702328448 00000100:00100000:0.0:1788845878.079575:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702328448 00000100:00100000:0.0:1788845878.079594:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788845878.079599:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702327296:12345-0@lo:400: 00000100:00100000:0.0:1788845878.079633:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702327296:12345-0@lo:400: Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.079639:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788845878.079650:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788845878.079655:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702328448:12345-0@lo:41: 00000004:00000024:0.0:1788845878.079683:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788845878.079721:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702328448:12345-0@lo:41: Request processed in 65us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.079726:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788845878.079762:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845878.079955:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788845878.079966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702326912:12345-0@lo:400: 00000100:00100000:1.0:1788845878.080003:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702326912:12345-0@lo:400: Request processed in 40us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.080007:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702328448:0@lo:41: 00000100:00100000:1.0:1788845878.080014:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788845878.080045:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788845878.080052:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702327424:12345-0@lo:400: 00000100:00100000:1.0:1788845878.080082:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702327424:12345-0@lo:400: Request processed in 30us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845878.080088:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788845878.080099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845878.080106:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702326912:0@lo:400: 00000100:00100000:1.0:1788845878.080107:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702327936:12345-0@lo:400: 00000100:00100000:0.0:1788845878.080127:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702327424:0@lo:400: 00000100:00100000:1.0:1788845878.080301:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702327936:12345-0@lo:400: Request processed in 195us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845878.080315:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788845878.080406:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702328192:0@lo:400: 00000100:00100000:3.0:1788845878.080434:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845878.080485:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702327168:0@lo:400: 00000100:00100000:3.0:1788845878.080515:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702327680 00000100:00100000:3.0:1788845878.080534:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702327680 00000100:00100000:3.0:1788845878.080564:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702328192 00000100:00100000:3.0:1788845878.080568:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702328192 00000100:00100000:3.0:1788845878.080699:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845878.080709:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702327680:12345-0@lo:400: 00000100:00100000:3.0:1788845878.080747:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702327680:12345-0@lo:400: Request processed in 41us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845878.080753:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788845878.080765:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788845878.080770:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702328192:12345-0@lo:400: 00000100:00100000:3.0:1788845878.080808:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702328192:12345-0@lo:400: Request processed in 39us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845878.080814:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788845878.080833:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788845878.080853:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c10380 x1875740702327680/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845878.080863:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702327680:0@lo:400: 00010000:00080000:3.0:1788845878.080873:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458336680 x1875740702328192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845878.080881:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702328192:0@lo:400: 00000100:00100000:1.0:1788845878.080986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845878.081016:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702328320:0@lo:400: 00000100:00100000:1.0:1788845878.081052:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845878.081169:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702327936:0@lo:400: 00000100:00100000:1.0:1788845878.081235:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702326784:0@lo:400: 00000100:00100000:1.0:1788845878.081247:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702327296:0@lo:400: 00000100:00100000:2.0:1788845878.086215:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702327808 00000100:00100000:2.0:1788845878.086231:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702327808 00000100:00100000:2.0:1788845878.086298:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702328320 00000100:00100000:2.0:1788845878.086302:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702328320 00000100:00100000:2.0:1788845878.086354:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788845878.086364:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702327808:12345-0@lo:400: 00000100:00080000:1.0:1788845878.086681:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788845878.086725:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c10000 x1875740702327808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845878.086743:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702327808:0@lo:400: 00000100:00100000:0.0:1788845878.087085:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788845878.087096:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702328320:12345-0@lo:400: 00000100:00100000:0.0:1788845878.087155:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702328320:12345-0@lo:400: Request processed in 62us (6102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845878.087162:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788845878.087279:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3ef100 x1875740702328320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845878.087290:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702328320:0@lo:400: 00000100:00100000:2.0:1788845878.087357:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702327808:12345-0@lo:400: Request processed in 994us (6369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.087364:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788845878.587182:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845878.587207:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702328576:0@lo:13: 00000100:00100000:0.0:1788845878.587279:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.587359:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702328576 00000100:00100000:2.0:1788845878.587367:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702328576 00000100:00100000:2.0:1788845878.587423:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845878.587432:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702328576:12345-0@lo:13: 00002000:00000024:2.0:1788845878.587460:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845878.587462:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845878.587472:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702328704:0@lo:13: 00000100:00100000:1.0:1788845878.587495:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845878.587506:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702328576:12345-0@lo:13: Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.587513:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845878.587545:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702328704 00000100:00100000:2.0:1788845878.587549:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702328704 00010000:00080000:1.0:1788845878.587561:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1180 x1875740702328576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845878.587563:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788845878.587568:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702328704:12345-0@lo:13: 00002000:00000024:2.0:1788845878.587577:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845878.587579:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702328576:0@lo:13: 00000100:00100000:2.0:1788845878.587610:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702328704:12345-0@lo:13: Request processed in 41us (114us total) trans 0 rc 0/0 00010000:00080000:1.0:1788845878.587627:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3ef100 x1875740702328704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845878.587629:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788845878.587638:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702328704:0@lo:13: 00000100:00100000:3.0:1788845878.792390:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845878.793740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683406848 00000100:00100000:2.0:1788845878.793764:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683406848 00000100:00100000:2.0:1788845878.793861:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1788845878.793874:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:6246:x1875740683406848:12345-192.168.203.20@tcp:41: 00000004:00000024:2.0:1788845878.793917:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788845878.793997:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:6246:x1875740683406848:12345-192.168.203.20@tcp:41: Request processed in 126us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.794006:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00080000:1.0:1788845878.794397:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845878.797959:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845878.798207:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683406976 00000100:00100000:2.0:1788845878.798218:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683406976 00000100:00100000:2.0:1788845878.798302:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1788845878.798313:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6246:x1875740683406976:12345-192.168.203.20@tcp:41: 00000004:00000024:2.0:1788845878.798349:0:7876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845878.798422:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6246:x1875740683406976:12345-192.168.203.20@tcp:41: Request processed in 110us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.798429:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00080000:1.0:1788845878.798510:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845878.806257:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845878.807878:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683407104 00000100:00100000:2.0:1788845878.807892:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683407104 00000100:00100000:2.0:1788845878.807982:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1788845878.808002:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6246:x1875740683407104:12345-192.168.203.20@tcp:13: 00002000:00000024:2.0:1788845878.808036:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845878.808120:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6246:x1875740683407104:12345-192.168.203.20@tcp:13: Request processed in 121us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.808127:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00080000:1.0:1788845878.808362:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845878.824705:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845878.824806:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683407232 00000100:00100000:2.0:1788845878.824816:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683407232 00000100:00100000:2.0:1788845878.824890:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1788845878.824900:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6246:x1875740683407232:12345-192.168.203.20@tcp:13: 00002000:00000024:2.0:1788845878.824935:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845878.825005:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:6246:x1875740683407232:12345-192.168.203.20@tcp:13: Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845878.825021:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00080000:1.0:1788845878.825399:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788845879.097694:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845880.123283:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845880.123323:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702328832:0@lo:41: 00010000:00010000:2.0:1788845880.123403:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845880.124229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1788845880.124258:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000100:00100000:0.0:1788845880.124490:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702328832 00000100:00100000:0.0:1788845880.124543:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702328832 00000100:00100000:0.0:1788845880.124614:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788845880.124628:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702328832:12345-0@lo:41: 00000004:00000024:0.0:1788845880.124677:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788845880.125229:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702328832:12345-0@lo:41: Request processed in 600us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845880.125248:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788845880.125559:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702328832:0@lo:41: 00010000:00010000:3.0:1788845881.145816:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788845881.154875:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000001:00100000:0.0:1788845881.155918:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000100:00100000:3.0:1788845881.204078:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845881.204154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845881.204193:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845881.204219:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845881.204245:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845881.204284:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683407872 00000100:00100000:3.0:1788845881.204297:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683407872 00000100:00100000:3.0:1788845881.204377:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683407744 00000100:00100000:3.0:1788845881.204382:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683407744 00000100:00100000:1.0:1788845881.204398:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683407360 00000100:00100000:1.0:1788845881.204406:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683407360 00000100:00100000:3.0:1788845881.204429:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1788845881.204445:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683407872:12345-192.168.203.20@tcp:400: 00000100:00100000:1.0:1788845881.204453:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 197 00000100:00100000:1.0:1788845881.204464:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683407360:12345-192.168.203.20@tcp:400: 00000100:00100000:1.0:1788845881.204565:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683407360:12345-192.168.203.20@tcp:400: Request processed in 103us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845881.204574:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 197 00000100:00100000:2.0:1788845881.205661:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683407616 00000100:00100000:2.0:1788845881.205681:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683407616 00000100:00100000:2.0:1788845881.205736:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683407488 00000100:00100000:2.0:1788845881.205739:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683407488 00000100:00100000:2.0:1788845881.205770:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:2.0:1788845881.205781:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683407616:12345-192.168.203.20@tcp:400: 00000100:00100000:3.0:1788845881.205895:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683407872:12345-192.168.203.20@tcp:400: Request processed in 1455us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845881.205905:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1788845881.205924:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1788845881.205932:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683407744:12345-192.168.203.20@tcp:400: 00000100:00100000:3.0:1788845881.205955:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683407744:12345-192.168.203.20@tcp:400: Request processed in 25us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845881.205961:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1788845881.205979:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1788845881.205986:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683407488:12345-192.168.203.20@tcp:400: 00000100:00100000:3.0:1788845881.206018:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683407488:12345-192.168.203.20@tcp:400: Request processed in 33us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845881.206024:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00080000:3.0:1788845881.206047:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788845881.206051:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788845881.206054:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788845881.206068:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845881.215938:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683407616:12345-192.168.203.20@tcp:400: Request processed in 10143us (11766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845881.215957:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000001:02000400:2.0:1788845881.544648:0:10179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788845882.169854:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788845882.173310:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000100:00100000:2.0:1788845882.684984:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702328960:0@lo:13: 00000100:00100000:2.0:1788845882.685089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845882.685187:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702328960 00000100:00100000:2.0:1788845882.685196:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702328960 00000100:00100000:2.0:1788845882.685273:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788845882.685285:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702328960:12345-0@lo:13: 00002000:00000024:2.0:1788845882.685331:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845882.685382:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702328960:12345-0@lo:13: Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845882.685389:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788845882.685459:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a6d80 x1875740702328960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845882.685479:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702328960:0@lo:13: 00000100:00080000:2.0:1788845882.685546:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845882.686005:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702329088:0@lo:13: 00000100:00100000:2.0:1788845882.686050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845882.686126:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702329088 00000100:00100000:1.0:1788845882.686134:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702329088 00000100:00100000:1.0:1788845882.686177:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788845882.686185:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702329088:12345-0@lo:13: 00002000:00000024:1.0:1788845882.686202:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845882.686239:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702329088:12345-0@lo:13: Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845882.686246:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788845882.686295:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845882.686318:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3ef100 x1875740702329088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845882.686332:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702329088:0@lo:13: 00000100:00100000:1.0:1788845883.194306:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702329216:0@lo:400: 00010000:00010000:2.0:1788845883.194342:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845883.194357:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702329344:0@lo:400: 00000100:00100000:2.0:1788845883.194413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845883.194414:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.194488:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702329856:0@lo:400: 00000100:00100000:1.0:1788845883.194501:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702329728:0@lo:400: 00000100:00100000:2.0:1788845883.194540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.194565:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702330368:0@lo:400: 00000100:00100000:2.0:1788845883.194591:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845883.194617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.194631:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702329472:0@lo:400: 00000100:00100000:1.0:1788845883.194645:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702330240:0@lo:400: 00000100:00100000:2.0:1788845883.194663:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.194686:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702329984:0@lo:400: 00000100:00100000:1.0:1788845883.194696:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845883.194725:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702330752:0@lo:400: 00000100:00100000:2.0:1788845883.194733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.194759:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702330496:0@lo:400: 00000100:00100000:1.0:1788845883.194760:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.194793:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845883.194809:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702329216 00000100:00100000:2.0:1788845883.194812:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788845883.194820:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702329216 00000100:00100000:2.0:1788845883.194821:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702329600:0@lo:400: 00000100:00100000:2.0:1788845883.194848:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.194862:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702330112:0@lo:400: 00000100:00100000:2.0:1788845883.194885:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845883.194889:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788845883.194901:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702329216:12345-0@lo:400: 00000100:00100000:2.0:1788845883.194908:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702330624:0@lo:400: 00000100:00100000:2.0:1788845883.194931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845883.194973:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702329216:12345-0@lo:400: Request processed in 72us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.194974:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702329344 00000100:00100000:2.0:1788845883.194980:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702329344 00000100:00100000:1.0:1788845883.194996:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788845883.195021:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702329856 00000100:00100000:2.0:1788845883.195026:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702329856 00000100:00100000:1.0:1788845883.195041:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702330240 00000100:00100000:1.0:1788845883.195048:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702330240 00000100:00100000:2.0:1788845883.195057:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702330368 00000100:00100000:2.0:1788845883.195062:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702330368 00000100:00100000:1.0:1788845883.195075:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702330752 00000100:00100000:1.0:1788845883.195081:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702330752 00000100:00100000:2.0:1788845883.195084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702329984 00000100:00100000:2.0:1788845883.195089:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702329984 00000100:00100000:1.0:1788845883.195105:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702330112 00000100:00100000:1.0:1788845883.195110:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702330112 00000100:00100000:2.0:1788845883.195113:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702330496 00000100:00100000:2.0:1788845883.195118:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702330496 00000100:00100000:1.0:1788845883.195131:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702330624 00000100:00100000:1.0:1788845883.195136:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702330624 00000100:00100000:2.0:1788845883.195141:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702329600 00000100:00100000:2.0:1788845883.195146:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702329600 00000100:00100000:1.0:1788845883.195161:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845883.195174:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845883.195175:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702330240:12345-0@lo:400: 00000100:00100000:2.0:1788845883.195187:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702329344:12345-0@lo:400: 00000100:00100000:2.0:1788845883.195236:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702329344:12345-0@lo:400: Request processed in 53us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845883.195244:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702330240:12345-0@lo:400: Request processed in 73us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195246:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788845883.195256:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788845883.195268:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788845883.195277:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845883.195278:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702329856:12345-0@lo:400: 00000100:00100000:1.0:1788845883.195290:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702330752:12345-0@lo:400: 00000100:00100000:2.0:1788845883.195331:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702329856:12345-0@lo:400: Request processed in 56us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845883.195340:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702330752:12345-0@lo:400: Request processed in 54us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195341:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788845883.195351:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788845883.195361:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788845883.195370:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702330368:12345-0@lo:400: 00000100:00100000:1.0:1788845883.195378:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845883.195387:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702330112:12345-0@lo:400: 00000100:00100000:2.0:1788845883.195406:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702330368:12345-0@lo:400: Request processed in 38us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195414:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788845883.195428:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788845883.195435:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702330112:12345-0@lo:400: Request processed in 49us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195439:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702329984:12345-0@lo:400: 00000100:00100000:1.0:1788845883.195448:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788845883.195463:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788845883.195472:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702330624:12345-0@lo:400: 00000100:00100000:2.0:1788845883.195479:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702329984:12345-0@lo:400: Request processed in 43us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788845883.195503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788845883.195510:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702330624:12345-0@lo:400: Request processed in 39us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195514:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702330496:12345-0@lo:400: 00000100:00100000:1.0:1788845883.195549:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788845883.195579:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702330496:12345-0@lo:400: Request processed in 69us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195587:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788845883.195603:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788845883.195611:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702329600:12345-0@lo:400: 00010000:00080000:1.0:1788845883.195621:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a7100 x1875740702330112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845883.195638:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702330112:0@lo:400: 00000100:00100000:2.0:1788845883.195644:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702329600:12345-0@lo:400: Request processed in 32us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195653:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788845883.195658:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a5f80 x1875740702330624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845883.195670:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702330624:0@lo:400: 00010000:00080000:1.0:1788845883.195685:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a5500 x1875740702329984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845883.195686:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702329728 00000100:00100000:2.0:1788845883.195692:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702329728 00000100:00100000:1.0:1788845883.195700:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702329984:0@lo:400: 00010000:00080000:1.0:1788845883.195723:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a4380 x1875740702330496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845883.195724:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702329472 00000100:00100000:1.0:1788845883.195734:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702330496:0@lo:400: 00000100:00100000:2.0:1788845883.195735:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702329472 00000100:00100000:2.0:1788845883.195761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788845883.195771:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702329728:12345-0@lo:400: 00000100:00100000:1.0:1788845883.195778:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702329600:0@lo:400: 00010000:00080000:1.0:1788845883.195814:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a4a80 x1875740702330240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845883.195815:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702329728:12345-0@lo:400: Request processed in 45us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195823:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788845883.195836:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702330240:0@lo:400: 00000100:00100000:2.0:1788845883.195840:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788845883.195852:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702329472:12345-0@lo:400: 00010000:00080000:1.0:1788845883.195859:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a7480 x1875740702330752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845883.195868:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702330752:0@lo:400: 00000100:00100000:1.0:1788845883.195882:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702329216:0@lo:400: 00000100:00100000:2.0:1788845883.195895:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702329472:12345-0@lo:400: Request processed in 46us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.195902:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788845883.195909:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702329728:0@lo:400: 00000100:00080000:2.0:1788845883.195942:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788845883.195948:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845883.195950:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845883.195975:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702329344:0@lo:400: 00000100:00100000:2.0:1788845883.196001:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702329856:0@lo:400: 00000100:00100000:2.0:1788845883.196013:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702330368:0@lo:400: 00000100:00100000:2.0:1788845883.196041:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702329472:0@lo:400: 00000100:00100000:1.0:1788845883.198301:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702330880:0@lo:41: 00000100:00100000:1.0:1788845883.198397:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845883.198510:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702330880 00000100:00100000:2.0:1788845883.198544:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702330880 00000100:00100000:2.0:1788845883.198606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788845883.198619:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702330880:12345-0@lo:41: 00000004:00000024:2.0:1788845883.198680:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788845883.198735:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702330880:12345-0@lo:41: Request processed in 118us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845883.198743:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845883.198868:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702330880:0@lo:41: 00000100:00100000:1.0:1788845883.707672:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702331008:0@lo:13: 00000100:00100000:1.0:1788845883.708096:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845883.708237:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845883.708247:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702331136:0@lo:13: 00000100:00100000:1.0:1788845883.708644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845883.708697:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702331008 00000100:00100000:1.0:1788845883.708815:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702331008 00000100:00100000:1.0:1788845883.708936:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702331136 00000100:00100000:1.0:1788845883.708940:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702331136 00000100:00100000:1.0:1788845883.708958:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845883.708968:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702331008:12345-0@lo:13: 00002000:00000024:1.0:1788845883.709018:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845883.709075:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702331008:12345-0@lo:13: Request processed in 109us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845883.709083:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788845883.709117:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788845883.709123:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702331136:12345-0@lo:13: 00002000:00000024:1.0:1788845883.709133:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845883.709156:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702331136:12345-0@lo:13: Request processed in 33us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845883.709290:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788845883.714512:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1f80 x1875740702331136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845883.714563:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702331136:0@lo:13: 00010000:00080000:2.0:1788845883.714581:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3eea00 x1875740702331008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845883.714594:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702331008:0@lo:13: 00010000:00010000:3.0:1788845884.218623:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845885.241743:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845885.241788:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702331264:0@lo:41: 00000100:00100000:1.0:1788845885.241880:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845885.241983:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845885.241985:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702331264 00000100:00100000:3.0:1788845885.241997:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702331264 00000100:00100000:3.0:1788845885.242069:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845885.242081:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702331264:12345-0@lo:41: 00000004:00000024:3.0:1788845885.242122:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788845885.242180:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702331264:12345-0@lo:41: Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845885.242188:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845885.242251:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702331264:0@lo:41: 00000020:00000080:1.0:1788845885.322472:0:10326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5d31e550 20000000:00000080:1.0:1788845885.322497:0:10326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e47f49ec00 uarg=0000000000000000 20000000:01000000:1.0:1788845885.322581:0:10326:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788845885.322584:0:10326:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788845885.322587:0:10326:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788845885.322594:0:10326:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788845885.322600:0:10326:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788845885.322671:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788845885.322674:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788845885.326044:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788845885.326470:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788845885.326511:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788845885.326563:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788845885.326579:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788845885.326582:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788845885.327218:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788845885.327433:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788845885.327456:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788845885.327469:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788845885.327482:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788845885.327484:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788845885.329054:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788845885.329344:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788845885.329376:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788845885.329392:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788845885.329403:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788845885.329406:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788845885.334016:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788845885.334667:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788845885.334708:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788845885.334725:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788845885.334741:0:10326:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788845885.334744:0:10326:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788845885.335430:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788845885.335732:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788845885.335758:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788845885.335773:0:10326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:2.0:1788845885.335792:0:10326:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788845885.335825:0:10326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335846:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382717e9 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335855:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271813 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335862:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271852 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335868:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271860 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335876:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827186e expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335883:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827188a expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335889:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382718b4 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335896:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382718d0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335902:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382718fa expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335913:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335931:0:10326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335939:0:10326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.335999:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.336019:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 9 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.336037:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331392:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788845885.336179:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.336188:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 9 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.336197:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331520:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788845885.336244:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382718fa expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.336253:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382718fa expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.336263:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331648:0@lo:104: 00000100:00100000:2.0:1788845885.336321:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845885.336420:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382718d0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.336429:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382718d0 expref: 23 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.336436:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331776:0@lo:104: 00000100:00100000:2.0:1788845885.336457:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.337905:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702331648 00000100:00100000:1.0:1788845885.337921:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702331648 00010000:00010000:2.0:1788845885.338007:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382718b4 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.338022:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382718b4 expref: 23 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.338034:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331904:0@lo:104: 00000100:00100000:2.0:1788845885.338086:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845885.338104:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827188a expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.338113:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827188a expref: 23 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.338121:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332032:0@lo:104: 00000100:00100000:2.0:1788845885.338147:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788845885.338165:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827186e expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.338173:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827186e expref: 23 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.338182:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332160:0@lo:104: 00010000:00010000:2.0:1788845885.338235:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271860 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.338244:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271860 expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.338253:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332288:0@lo:104: 00010000:00010000:2.0:1788845885.338277:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271852 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.338284:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271852 expref: 23 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.338292:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332416:0@lo:104: 00010000:00010000:2.0:1788845885.338332:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271813 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.338340:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271813 expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.338349:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332544:0@lo:104: 00010000:00010000:2.0:1788845885.338377:0:10326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382717e9 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.338386:0:10326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382717e9 expref: 23 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.338394:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332672:0@lo:104: 00000100:00100000:2.0:1788845885.338413:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845885.338669:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788845885.338691:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845885.338704:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845885.338714:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845885.338722:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845885.338730:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845885.338737:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702331776 00000100:00100000:0.0:1788845885.338741:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702331776 00000100:00100000:0.0:1788845885.338758:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702331904 00000100:00100000:0.0:1788845885.338760:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702331904 00000100:00100000:0.0:1788845885.338770:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702332032 00000100:00100000:0.0:1788845885.338772:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702332032 00000100:00100000:0.0:1788845885.338781:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702332160 00000100:00100000:0.0:1788845885.338783:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702332160 00000100:00100000:0.0:1788845885.338791:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702332288 00000100:00100000:0.0:1788845885.338793:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702332288 00000100:00100000:0.0:1788845885.338800:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702332416 00000100:00100000:0.0:1788845885.338802:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702332416 00000100:00100000:0.0:1788845885.338812:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702332544 00000100:00100000:0.0:1788845885.338814:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702332544 00000100:00100000:0.0:1788845885.338822:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702332672 00000100:00100000:0.0:1788845885.338825:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702332672 00000100:00100000:0.0:1788845885.338838:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845885.338848:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:10326:x1875740702331648:12345-0@lo:104: 00010000:00010000:0.0:1788845885.338863:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.338947:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845885.338954:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+11:10326:x1875740702331648:12345-0@lo:104: Request processed in 107us (2633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.338962:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788845885.338992:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845885.338999:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:10326:x1875740702331776:12345-0@lo:104: 00010000:00010000:0.0:1788845885.339008:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.339049:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788845885.339055:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+10:10326:x1875740702331776:12345-0@lo:104: Request processed in 58us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.339061:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788845885.339073:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788845885.339079:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:10326:x1875740702331904:12345-0@lo:104: 00010000:00010000:0.0:1788845885.339087:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.339119:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788845885.339123:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+9:10326:x1875740702331904:12345-0@lo:104: Request processed in 45us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.339130:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788845885.339140:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845885.339146:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+8:10326:x1875740702332032:12345-0@lo:104: 00010000:00010000:0.0:1788845885.339153:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.339188:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788845885.339193:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+8:10326:x1875740702332032:12345-0@lo:104: Request processed in 48us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.339199:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845885.339245:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788845885.339252:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+7:10326:x1875740702332160:12345-0@lo:104: 00010000:00010000:0.0:1788845885.339259:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.339285:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788845885.339289:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+7:10326:x1875740702332160:12345-0@lo:104: Request processed in 39us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.339295:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788845885.339305:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788845885.339311:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:10326:x1875740702332288:12345-0@lo:104: 00010000:00010000:0.0:1788845885.339318:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.339341:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788845885.339346:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:10326:x1875740702332288:12345-0@lo:104: Request processed in 35us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.339351:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788845885.339361:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788845885.339367:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:10326:x1875740702332416:12345-0@lo:104: 00010000:00010000:0.0:1788845885.339374:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.339408:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788845885.339413:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:10326:x1875740702332416:12345-0@lo:104: Request processed in 47us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.339420:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788845885.339433:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788845885.339439:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:10326:x1875740702332544:12345-0@lo:104: 00010000:00010000:0.0:1788845885.339448:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.339472:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1788845885.339476:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:10326:x1875740702332544:12345-0@lo:104: Request processed in 39us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.339482:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788845885.339494:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788845885.339500:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:10326:x1875740702332672:12345-0@lo:104: 00010000:00010000:0.0:1788845885.339507:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845885.339564:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1788845885.339568:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:10326:x1875740702332672:12345-0@lo:104: Request processed in 70us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.339574:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788845885.339724:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788845885.339733:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339741:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0dc00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.339745:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339762:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.339770:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.339778:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.339824:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339831:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.339856:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339863:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0dc00/0x21b4d561382718fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271901 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339882:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788845885.339885:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339891:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4536e7200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.339894:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339901:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.339907:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.339918:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.339933:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339940:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.339955:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339962:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4536e7200/0x21b4d561382718d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382718d7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339982:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788845885.339986:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.339992:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0cc00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.339996:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340002:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.340007:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.340013:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.340026:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340031:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.340042:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340048:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d561382718b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382718bb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340058:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788845885.340061:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340067:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441442a00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.340069:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340075:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.340081:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.340087:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.340101:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340107:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.340112:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340118:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441442a00/0x21b4d5613827188a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271891 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340128:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788845885.340137:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340143:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4536e7a00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.340145:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340151:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.340158:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.340163:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.340177:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340182:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.340186:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340191:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4536e7a00/0x21b4d5613827186e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271875 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340200:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788845885.340203:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340209:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441443600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.340212:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340242:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.340248:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.340253:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.340267:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340273:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.340278:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340285:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271860 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271867 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340296:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788845885.340299:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340305:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441442400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.340308:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340315:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.340321:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.340332:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.340347:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340353:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.340357:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340363:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271859 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340373:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788845885.340376:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340381:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.340384:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340390:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.340397:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.340402:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.340414:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340419:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.340431:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340437:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d56138271813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827181a expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340447:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845885.340450:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340456:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42de00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788845885.340459:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340466:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788845885.340472:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845885.340477:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788845885.340490:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340495:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788845885.340499:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340505:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42de00/0x21b4d561382717e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382717f0 expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.340560:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845885.340568:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845885.340569:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845885.340579:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845885.340597:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702332800:0@lo:103: 00000100:00100000:1.0:1788845885.340656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.340698:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702333312:0@lo:103: 00000100:00100000:1.0:1788845885.340720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.340737:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702333824:0@lo:103: 00000100:00100000:1.0:1788845885.340754:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.340777:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788845885.340783:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702333184:0@lo:103: 00000100:00100000:1.0:1788845885.340802:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.340810:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702333696:0@lo:103: 00000100:00100000:1.0:1788845885.340827:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.340853:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702332928:0@lo:103: 00000100:00100000:1.0:1788845885.340875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.340884:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702333440:0@lo:103: 00000100:00100000:1.0:1788845885.340899:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.340908:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788845885.340912:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702333056:0@lo:103: 00000100:00100000:1.0:1788845885.340927:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.340934:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702333568:0@lo:103: 00000100:00100000:1.0:1788845885.340949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845885.341002:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702332800 00000100:00100000:1.0:1788845885.341010:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702332800 00010000:00010000:1.0:1788845885.341044:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382718fa expref: 24 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341072:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702333312 00000100:00100000:1.0:1788845885.341076:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702333312 00010000:00010000:1.0:1788845885.341105:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827186e expref: 25 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341118:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702333824 00000100:00100000:1.0:1788845885.341121:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702333824 00010000:00010000:1.0:1788845885.341131:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382717e9 expref: 26 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341139:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702333184 00000100:00100000:1.0:1788845885.341141:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702333184 00010000:00010000:1.0:1788845885.341149:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827188a expref: 27 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341156:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702333696 00000100:00100000:1.0:1788845885.341159:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702333696 00010000:00010000:1.0:1788845885.341166:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271813 expref: 28 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341175:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702332928 00000100:00100000:1.0:1788845885.341177:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702332928 00010000:00010000:1.0:1788845885.341186:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382718d0 expref: 29 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341195:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702333440 00000100:00100000:1.0:1788845885.341197:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702333440 00010000:00010000:1.0:1788845885.341207:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271860 expref: 30 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341217:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702333056 00000100:00100000:1.0:1788845885.341225:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702333056 00010000:00010000:1.0:1788845885.341238:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382718b4 expref: 31 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341247:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702333568 00000100:00100000:1.0:1788845885.341249:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702333568 00010000:00010000:1.0:1788845885.341257:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271852 expref: 32 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.341269:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788845885.341276:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+32:3641:x1875740702332800:12345-0@lo:103: 00010000:00010000:1.0:1788845885.341289:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.341294:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382718fa expref: 32 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341304:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382718fa expref: 32 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341324:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.341362:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+32:3641:x1875740702332800:12345-0@lo:103: Request processed in 86us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.341369:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788845885.341428:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788845885.341434:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+31:3641:x1875740702333312:12345-0@lo:103: 00010000:00010000:1.0:1788845885.341440:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.341444:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827186e expref: 31 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341453:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827186e expref: 31 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341471:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.341491:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+31:3641:x1875740702333312:12345-0@lo:103: Request processed in 58us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.341498:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788845885.341509:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845885.341514:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+30:3641:x1875740702333824:12345-0@lo:103: 00010000:00010000:1.0:1788845885.341547:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.341552:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382717e9 expref: 30 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341560:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382717e9 expref: 30 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341569:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.341588:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+30:3641:x1875740702333824:12345-0@lo:103: Request processed in 74us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.341594:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788845885.341604:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845885.341610:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+29:3641:x1875740702333184:12345-0@lo:103: 00010000:00010000:1.0:1788845885.341616:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.341619:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827188a expref: 29 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341627:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827188a expref: 29 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341635:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.341663:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+29:3641:x1875740702333184:12345-0@lo:103: Request processed in 53us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.341669:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845885.341682:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788845885.341687:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+28:3641:x1875740702333696:12345-0@lo:103: 00010000:00010000:1.0:1788845885.341694:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.341699:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271813 expref: 28 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341708:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271813 expref: 28 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341717:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.341737:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+28:3641:x1875740702333696:12345-0@lo:103: Request processed in 50us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.341742:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788845885.341754:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788845885.341760:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+27:3642:x1875740702332928:12345-0@lo:103: 00010000:00010000:1.0:1788845885.341767:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.341771:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382718d0 expref: 27 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341779:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382718d0 expref: 27 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341788:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.341815:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+27:3642:x1875740702332928:12345-0@lo:103: Request processed in 56us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.341821:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788845885.341840:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845885.341845:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+26:3642:x1875740702333440:12345-0@lo:103: 00010000:00010000:1.0:1788845885.341853:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.341857:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271860 expref: 26 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341865:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271860 expref: 26 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341874:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.341895:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+26:3642:x1875740702333440:12345-0@lo:103: Request processed in 50us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.341901:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788845885.341912:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845885.341918:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+25:3642:x1875740702333056:12345-0@lo:103: 00010000:00010000:1.0:1788845885.341926:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.341929:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382718b4 expref: 25 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341938:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382718b4 expref: 25 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.341946:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.341966:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+25:3642:x1875740702333056:12345-0@lo:103: Request processed in 48us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.341987:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845885.342014:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845885.342021:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702333568:12345-0@lo:103: 00010000:00010000:1.0:1788845885.342028:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.342038:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271852 expref: 24 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.342046:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271852 expref: 24 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.342055:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845885.342076:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702333568:12345-0@lo:103: Request processed in 56us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.342083:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788845885.342136:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702333056:0@lo:103: 00000100:00100000:1.0:1788845885.342144:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702333568:0@lo:103: 00000100:00100000:1.0:1788845885.342150:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702332928:0@lo:103: 00000100:00100000:1.0:1788845885.342156:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702333440:0@lo:103: 00000100:00100000:1.0:1788845885.342190:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702333184:0@lo:103: 00000100:00100000:1.0:1788845885.342196:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702333696:0@lo:103: 00000100:00100000:1.0:1788845885.342202:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702332800:0@lo:103: 00000100:00100000:1.0:1788845885.342209:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702333312:0@lo:103: 00000100:00100000:1.0:1788845885.342214:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702333824:0@lo:103: 00010000:00010000:2.0:1788845885.342422:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0d800/0x21b4d56138271901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382718fa expref: 23 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342440:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331648:0@lo:104: 00010000:00010000:2.0:1788845885.342452:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e6600/0x21b4d561382718d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382718d0 expref: 22 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342461:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331776:0@lo:104: 00010000:00010000:2.0:1788845885.342472:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e6400/0x21b4d561382718bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382718b4 expref: 21 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342479:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331904:0@lo:104: 00010000:00010000:2.0:1788845885.342490:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7c00/0x21b4d56138271891 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827188a expref: 20 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342498:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332032:0@lo:104: 00010000:00010000:2.0:1788845885.342507:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e6000/0x21b4d56138271875 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827186e expref: 19 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342514:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332160:0@lo:104: 00010000:00010000:2.0:1788845885.342559:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7800/0x21b4d56138271867 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271860 expref: 18 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342568:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332288:0@lo:104: 00010000:00010000:2.0:1788845885.342578:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065400/0x21b4d56138271859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271852 expref: 17 pid: 6509 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342586:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332416:0@lo:104: 00010000:00010000:2.0:1788845885.342594:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d600/0x21b4d5613827181a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271813 expref: 16 pid: 6511 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342612:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332544:0@lo:104: 00010000:00010000:2.0:1788845885.342624:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42da00/0x21b4d561382717f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382717e9 expref: 15 pid: 6508 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.342632:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702332672:0@lo:104: 00010000:00010000:3.0:1788845885.343016:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845885.351405:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845885.351472:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683408000 00000100:00100000:1.0:1788845885.351484:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683408000 00000100:00100000:3.0:1788845885.351503:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1788845885.351601:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 10 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.351654:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683408128 00000100:00100000:1.0:1788845885.351670:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683408128 00010000:00010000:1.0:1788845885.351687:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 11 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.351706:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1788845885.351727:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:2399:x1875740683408000:12345-192.168.203.20@tcp:103: 00010000:00010000:1.0:1788845885.351747:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.351758:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 11 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351772:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 11 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351799:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845885.351825:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0d600/0x21b4d56138271916 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543b6 expref: 11 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845885.351840:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331392:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788845885.351850:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10326:1875740702331520:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788845885.351855:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683408000:12345-192.168.203.20@tcp:103: Request processed in 141us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.351862:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1788845885.351879:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:1.0:1788845885.351885:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:2399:x1875740683408128:12345-192.168.203.20@tcp:103: 00010000:00010000:1.0:1788845885.351892:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845885.351896:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 9 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351905:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 9 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.351906:0:10326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351916:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0de00/0x21b4d5613827190f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543af expref: 9 pid: 6511 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351938:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351947:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351965:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351982:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351989:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.351996:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.352004:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788845885.352008:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.352016:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.352037:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.352048:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845885.352052:0:10326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.352059:0:10326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845885.352066:0:10326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d400/0x21b4d56138271955 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845885.352067:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:2399:x1875740683408128:12345-192.168.203.20@tcp:103: Request processed in 181us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.352078:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:0.0:1788845885.754586:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845885.755186:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683408256 00000100:00100000:1.0:1788845885.755204:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683408256 00000100:00100000:1.0:1788845885.755407:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 199 00000100:00100000:1.0:1788845885.755426:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:6169:x1875740683408256:12345-192.168.203.20@tcp:101: 00010000:00010000:1.0:1788845885.755453:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845885.755486:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2000/0x21b4d5613827195c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754426 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.755568:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2000/0x21b4d5613827195c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754426 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.755581:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2000/0x21b4d5613827195c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754426 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.755592:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2000, rc 0) 00000100:00100000:1.0:1788845885.755689:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6169:x1875740683408256:12345-192.168.203.20@tcp:101: Request processed in 269us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845885.759719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845885.759980:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683408384 00000100:00100000:3.0:1788845885.759994:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683408384 00000100:00100000:1.0:1788845885.764403:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 199 00000100:00100000:2.0:1788845885.764569:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 200 00000100:00100000:2.0:1788845885.764582:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6169:x1875740683408384:12345-192.168.203.20@tcp:501: 00000100:00100000:2.0:1788845885.764802:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6169:x1875740683408384:12345-192.168.203.20@tcp:501: Request processed in 222us (5110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845885.764830:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 200 00000100:00100000:3.0:1788845885.769257:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845885.769764:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683408512 00000100:00100000:1.0:1788845885.769779:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683408512 00000100:00100000:1.0:1788845885.769858:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:1.0:1788845885.769869:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6169:x1875740683408512:12345-192.168.203.20@tcp:503: 00000100:00100000:1.0:1788845885.770084:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6169:x1875740683408512:12345-192.168.203.20@tcp:503: Request processed in 216us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.770093:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:3.0:1788845885.779030:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845885.780756:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683408640 00000100:00100000:0.0:1788845885.780776:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683408640 00000100:00100000:0.0:1788845885.781112:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:0.0:1788845885.781147:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6640:x1875740683408640:12345-192.168.203.20@tcp:502: 00000100:00100000:0.0:1788845885.781510:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6640:x1875740683408640:12345-192.168.203.20@tcp:502: Request processed in 297us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845885.781689:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:0.0:1788845885.787774:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845885.787886:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683408768 00000100:00100000:1.0:1788845885.787924:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683408768 00000100:00100000:1.0:1788845885.788016:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:1.0:1788845885.788028:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6640:x1875740683408768:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845885.788217:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6640:x1875740683408768:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 190us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.788358:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:0.0:1788845885.793337:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845885.793845:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683408896 00000100:00100000:1.0:1788845885.793860:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683408896 00000100:00100000:1.0:1788845885.793952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:1.0:1788845885.793973:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6169:x1875740683408896:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845885.793997:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845885.794022:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2400/0x21b4d56138271963 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175442d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.794061:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2400/0x21b4d56138271963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175442d expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.794074:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2400/0x21b4d56138271963 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175442d expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845885.794086:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2400, rc 0) 00000100:00100000:1.0:1788845885.794167:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6169:x1875740683408896:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 204us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845885.794177:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:2.0:1788845885.803605:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845885.803713:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683409024 00000100:00100000:0.0:1788845885.803729:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683409024 00000100:00100000:0.0:1788845885.803808:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:0.0:1788845885.803821:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6169:x1875740683409024:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845885.804009:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6169:x1875740683409024:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 191us (428us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788845885.804018:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 205 00010000:00010000:1.0:1788845886.265742:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845886.323169:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845886.323308:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845886.323353:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845886.323404:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845886.323471:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683409536 00000100:00100000:1.0:1788845886.323485:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683409536 00000100:00100000:1.0:1788845886.323604:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1788845886.323652:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683409536:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845886.323753:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683409536:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 106us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845886.323761:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00080000:1.0:1788845886.323818:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845886.328163:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683409152 00000100:00100000:0.0:1788845886.328187:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683409152 00000100:00100000:0.0:1788845886.328298:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 206 00000100:00100000:0.0:1788845886.328312:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683409152:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845886.328419:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683409152:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 110us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845886.328428:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 206 00000100:00100000:3.0:1788845886.329877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845886.330160:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683409664 00000100:00100000:1.0:1788845886.330172:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683409664 00000100:00100000:1.0:1788845886.330254:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788845886.330264:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683409664:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845886.330346:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683409664:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 84us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845886.330354:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00080000:3.0:1788845886.330454:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845886.330804:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683409280 00000100:00100000:2.0:1788845886.330812:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683409280 00000100:00100000:2.0:1788845886.330876:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683409408 00000100:00100000:2.0:1788845886.330880:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683409408 00000100:00100000:2.0:1788845886.330919:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:2.0:1788845886.330929:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683409280:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845886.331142:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683409280:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 215us (7989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845886.331150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:2.0:1788845886.331167:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:2.0:1788845886.331174:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683409408:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845886.331200:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683409408:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (7796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845886.331206:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00080000:3.0:1788845886.331741:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788845886.331746:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788845887.290385:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788845887.355945:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788845887.355967:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e342932800 from 48 10000000:01000000:2.0:1788845887.355974:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845887.356043:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.356057:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.356072:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.356123:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702333952:0@lo:101: 00000100:00100000:2.0:1788845887.356219:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.356294:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e445577c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.356370:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702333952 00000100:00100000:3.0:1788845887.356381:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702333952 00000100:00100000:3.0:1788845887.356462:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788845887.356483:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+15:6513:x1875740702333952:12345-0@lo:101: 00010000:00010000:3.0:1788845887.356502:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845887.356547:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064a00/0x21b4d56138271971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d5613827196a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.356578:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064a00/0x21b4d56138271971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d5613827196a expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.356591:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064a00/0x21b4d56138271971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827196a expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.356602:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064a00, rc 0) 00000100:00100000:3.0:1788845887.356781:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702333952:12345-0@lo:101: Request processed in 299us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.356789:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788845887.356908:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702333952:0@lo:101: 00010000:00010000:2.0:1788845887.356924:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.356935:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.357027:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334080:0@lo:501: 00000100:00100000:2.0:1788845887.357055:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.357086:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e445577c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.357132:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702334080 00000100:00100000:0.0:1788845887.357137:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702334080 00000100:00100000:0.0:1788845887.357175:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788845887.357183:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702334080:12345-0@lo:501: 00000100:00100000:0.0:1788845887.357325:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702334080:12345-0@lo:501: Request processed in 143us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.357341:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788845887.357454:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334080:0@lo:501: 00000100:00100000:2.0:1788845887.357483:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334208:0@lo:503: 00000100:00100000:2.0:1788845887.357871:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.357905:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e445577c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.357967:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702334208 00000100:00100000:3.0:1788845887.357973:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702334208 00000100:00100000:3.0:1788845887.358011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788845887.358019:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702334208:12345-0@lo:503: 00000100:00100000:3.0:1788845887.358146:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702334208:12345-0@lo:503: Request processed in 127us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.358154:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788845887.358254:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334208:0@lo:503: 00000100:00100000:2.0:1788845887.359136:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10359:1875740702334336:0@lo:502: 00000100:00100000:2.0:1788845887.359198:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.359241:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.359289:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702334336 00000100:00100000:0.0:1788845887.359296:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702334336 00000100:00100000:0.0:1788845887.359340:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788845887.359349:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:10359:x1875740702334336:12345-0@lo:502: 00000100:00100000:0.0:1788845887.359757:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:10359:x1875740702334336:12345-0@lo:502: Request processed in 407us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.359766:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788845887.363798:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10359:1875740702334336:0@lo:502: 00000100:00100000:3.0:1788845887.366499:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10359:1875740702334464:0@lo:502: 00000100:00100000:3.0:1788845887.366742:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845887.366795:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457840 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.366846:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702334464 00000100:00100000:0.0:1788845887.366856:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702334464 00000100:00100000:0.0:1788845887.366923:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788845887.366935:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:10359:x1875740702334464:12345-0@lo:502: 00000100:00100000:0.0:1788845887.367107:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:10359:x1875740702334464:12345-0@lo:502: Request processed in 173us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.367115:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788845887.367220:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10359:1875740702334464:0@lo:502: 00000040:00080000:2.0:1788845887.367258:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788845887.367477:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788845887.367502:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845887.367515:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.367556:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845887.367566:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788845887.367569:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788845887.367572:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788845887.367603:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.367619:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.367639:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.367658:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334592:0@lo:101: 00000100:00100000:0.0:1788845887.367690:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.367715:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.367823:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702334592 00000100:00100000:3.0:1788845887.367831:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702334592 00000100:00100000:3.0:1788845887.367869:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788845887.367884:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+16:6513:x1875740702334592:12345-0@lo:101: 00010000:00010000:3.0:1788845887.367895:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845887.367910:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064e00/0x21b4d5613827197f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271978 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.367935:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064e00/0x21b4d5613827197f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271978 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.367948:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064e00/0x21b4d5613827197f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271978 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.367968:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064e00, rc 0) 00000100:00100000:3.0:1788845887.368005:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702334592:12345-0@lo:101: Request processed in 122us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.368011:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788845887.368045:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334592:0@lo:101: 00010000:00010000:3.0:1788845887.368056:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.368066:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845887.368123:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334720:0@lo:501: 00000100:00100000:3.0:1788845887.368144:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845887.368156:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4604579c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.368169:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702334720 00000100:00100000:3.0:1788845887.368172:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702334720 00000100:00100000:3.0:1788845887.368190:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788845887.368196:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702334720:12345-0@lo:501: 00000100:00100000:3.0:1788845887.368314:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702334720:12345-0@lo:501: Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.368321:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788845887.368347:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334720:0@lo:501: 00000100:00100000:3.0:1788845887.368371:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334848:0@lo:503: 00000100:00100000:3.0:1788845887.368406:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845887.368418:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4604579c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.368505:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702334848 00000100:00100000:3.0:1788845887.368509:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702334848 00000100:00100000:3.0:1788845887.368554:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788845887.368561:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702334848:12345-0@lo:503: 00000100:00100000:3.0:1788845887.368709:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702334848:12345-0@lo:503: Request processed in 149us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.368715:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788845887.368750:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702334848:0@lo:503: 00000100:00100000:2.0:1788845887.381302:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10361:1875740702334976:0@lo:502: 00000100:00100000:2.0:1788845887.381499:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845887.381578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702334976 00000100:00100000:2.0:1788845887.381583:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.381587:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702334976 00000100:00100000:3.0:1788845887.381787:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788845887.381801:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:10361:x1875740702334976:12345-0@lo:502: 00000100:00100000:3.0:1788845887.381990:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:10361:x1875740702334976:12345-0@lo:502: Request processed in 191us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.381999:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788845887.382032:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10361:1875740702334976:0@lo:502: 00000020:01000000:2.0:1788845887.382071:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845887.382085:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845887.382088:0:10361:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788845887.382095:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788845887.382125:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10361:1875740702335104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.382163:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.382188:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.382252:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702335104 00000100:00100000:1.0:1788845887.382258:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702335104 00000100:00100000:1.0:1788845887.382292:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788845887.382299:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:10361:x1875740702335104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845887.382474:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:10361:x1875740702335104:12345-0@lo:502:llog_process_th.0 Request processed in 175us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.382482:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788845887.382545:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10361:1875740702335104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845887.382577:0:10361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845887.382583:0:10361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845887.382590:0:10361:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788845887.382594:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788845887.382935:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788845887.382972:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788845887.382985:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.382997:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845887.383014:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788845887.383017:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e451767800 from 48 10000000:01000000:1.0:1788845887.383020:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788845887.383052:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.383059:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.383068:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.383086:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702335232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.383431:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845887.383474:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e34278d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.383514:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702335232 00000100:00100000:3.0:1788845887.383533:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702335232 00000100:00100000:3.0:1788845887.383576:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788845887.383584:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+17:6513:x1875740702335232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845887.383597:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845887.383613:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064200/0x21b4d5613827198d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271986 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.383749:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064200/0x21b4d5613827198d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271986 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.383759:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064200/0x21b4d5613827198d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271986 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.383767:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064200, rc 0) 00000100:00100000:3.0:1788845887.383807:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702335232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.383814:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788845887.384029:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702335232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845887.384045:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.384055:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.384117:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702335360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.384144:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845887.384164:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e34278d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.384176:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702335360 00000100:00100000:1.0:1788845887.384179:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702335360 00000100:00100000:1.0:1788845887.384210:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788845887.384216:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702335360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.384327:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702335360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.384345:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788845887.384374:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702335360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.384398:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702335488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.384434:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845887.384452:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e34278d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.385449:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702335488 00000100:00100000:3.0:1788845887.385460:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702335488 00000100:00100000:3.0:1788845887.385560:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788845887.385568:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702335488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845887.385715:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702335488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.385722:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788845887.385826:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702335488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.390471:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10363:1875740702335616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845887.390594:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845887.390648:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d0ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.390723:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702335616 00000100:00100000:2.0:1788845887.390732:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702335616 00000100:00100000:2.0:1788845887.390798:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788845887.390809:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:10363:x1875740702335616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.390976:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:10363:x1875740702335616:12345-0@lo:502:llog_process_th.0 Request processed in 168us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.390983:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788845887.391226:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10363:1875740702335616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845887.391281:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10363:1875740702335744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845887.391315:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845887.391342:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d0ce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845887.391755:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702335744 00000100:00100000:3.0:1788845887.391761:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702335744 00000100:00100000:3.0:1788845887.391896:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788845887.391906:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:10363:x1875740702335744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845887.392030:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:10363:x1875740702335744:12345-0@lo:502:llog_process_th.0 Request processed in 126us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.392038:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788845887.392111:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10363:1875740702335744:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788845887.392134:0:10363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788845887.392599:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788845887.392622:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845887.392635:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.392648:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845887.392659:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788845887.392663:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788845887.392666:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845887.392696:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.392704:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.392714:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.392739:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702335872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.392778:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.398133:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702335872 00000100:00100000:2.0:1788845887.398156:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702335872 00000100:00100000:2.0:1788845887.398243:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788845887.398256:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+18:6513:x1875740702335872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845887.398276:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845887.398301:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42de00/0x21b4d5613827199b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271994 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.398353:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42de00/0x21b4d5613827199b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271994 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.398366:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42de00/0x21b4d5613827199b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271994 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.398376:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42de00, rc 0) 00000100:00100000:0.0:1788845887.398390:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.399616:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702335872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1355us (6828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.399749:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788845887.402616:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702335872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845887.402654:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.402670:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.402775:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.402935:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.402995:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.403003:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702336000 00000100:00100000:1.0:1788845887.403011:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702336000 00000100:00100000:1.0:1788845887.403065:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788845887.403075:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702336000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.403248:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702336000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.403265:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788845887.403423:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.403453:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.403497:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.403561:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.403628:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702336128 00000100:00100000:2.0:1788845887.403633:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702336128 00000100:00100000:2.0:1788845887.403668:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788845887.403675:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702336128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.404350:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702336128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 673us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.404359:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788845887.404507:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.405073:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10365:1875740702336256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845887.405124:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.405162:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.405276:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702336256 00000100:00100000:1.0:1788845887.405283:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702336256 00000100:00100000:1.0:1788845887.405324:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788845887.405331:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:10365:x1875740702336256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845887.405455:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:10365:x1875740702336256:12345-0@lo:502:llog_process_th.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.405462:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788845887.405629:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10365:1875740702336256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845887.405657:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845887.405673:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845887.405676:0:10365:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788845887.405681:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788845887.405704:0:10365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10365:1875740702336384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845887.405737:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.405764:0:10365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451890780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.405795:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702336384 00000100:00100000:2.0:1788845887.405802:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702336384 00000100:00100000:2.0:1788845887.405843:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788845887.405850:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:10365:x1875740702336384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.405938:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:10365:x1875740702336384:12345-0@lo:502:llog_process_th.0 Request processed in 88us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.405945:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788845887.405985:0:10365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10365:1875740702336384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845887.406005:0:10365:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845887.406079:0:10365:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845887.406081:0:10365:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788845887.406085:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788845887.406196:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788845887.406224:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788845887.406244:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.406256:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845887.406268:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788845887.406271:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e47518c000 from 48 10000000:01000000:2.0:1788845887.406274:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788845887.406304:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.406312:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.406322:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.406409:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.406444:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.406470:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.409735:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702336512 00000100:00100000:1.0:1788845887.409754:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702336512 00000100:00100000:1.0:1788845887.409826:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788845887.409837:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:6513:x1875740702336512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845887.409856:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845887.409883:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2600/0x21b4d561382719a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382719a2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.409918:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2600/0x21b4d561382719a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382719a2 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.409932:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2600/0x21b4d561382719a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382719a2 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.409942:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2600, rc 0) 00000100:00100000:1.0:1788845887.410045:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702336512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (3599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.410053:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788845887.410228:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845887.410249:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.410260:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.410347:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.410410:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.410458:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.410722:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702336640 00000100:00100000:1.0:1788845887.410735:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702336640 00000100:00100000:1.0:1788845887.410762:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788845887.410769:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702336640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.410970:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702336640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.410978:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788845887.411173:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.411212:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.411259:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.411316:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.411344:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702336768 00000100:00100000:1.0:1788845887.411349:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702336768 00000100:00100000:1.0:1788845887.411381:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788845887.411388:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702336768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.415468:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702336768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4066us (4195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.415486:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788845887.417706:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702336768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.418864:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10366:1875740702336896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.418975:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.419029:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315180 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.419087:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702336896 00000100:00100000:1.0:1788845887.419096:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702336896 00000100:00100000:1.0:1788845887.419158:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788845887.419168:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:10366:x1875740702336896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845887.419345:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:10366:x1875740702336896:12345-0@lo:502:llog_process_th.0 Request processed in 177us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.419354:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788845887.419465:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10366:1875740702336896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.419764:0:10366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10366:1875740702337024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.419814:0:10366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.419842:0:10366:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315180 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.420009:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702337024 00000100:00100000:0.0:1788845887.420017:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702337024 00000100:00100000:0.0:1788845887.420063:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788845887.420072:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:10366:x1875740702337024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845887.420179:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:10366:x1875740702337024:12345-0@lo:502:llog_process_th.0 Request processed in 109us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.420186:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788845887.420792:0:10366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10366:1875740702337024:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788845887.420830:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788845887.426291:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788845887.426345:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788845887.426362:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.426376:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845887.426390:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788845887.426393:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788845887.426397:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788845887.426467:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.426476:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.426488:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845887.426815:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845887.426915:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845887.426988:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.427006:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702337152 00000100:00100000:0.0:1788845887.427019:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702337152 00000100:00100000:0.0:1788845887.427085:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788845887.427095:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702337152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845887.427111:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845887.427129:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0c600/0x21b4d561382719b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382719b0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.427159:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0c600/0x21b4d561382719b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382719b0 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.427192:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0c600/0x21b4d561382719b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382719b0 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.427203:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0c600, rc 0) 00000100:00100000:0.0:1788845887.427260:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702337152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.427268:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788845887.427460:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845887.427484:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.427494:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845887.427611:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845887.427766:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845887.427817:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457540 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.433102:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702337280 00000100:00100000:1.0:1788845887.433125:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702337280 00000100:00100000:1.0:1788845887.435281:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788845887.435322:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702337280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.435577:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702337280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (7810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.435606:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788845887.435873:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.435942:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.436013:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845887.439670:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702337408 00000100:00100000:3.0:1788845887.439691:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702337408 00000100:00100000:3.0:1788845887.440081:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788845887.440096:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702337408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845887.440610:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702337408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 516us (4594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845887.440619:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788845887.441831:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.441874:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.460297:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10367:1875740702337536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845887.460424:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845887.460610:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702337536 00000100:00100000:1.0:1788845887.460621:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702337536 00000100:00100000:1.0:1788845887.460690:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788845887.460702:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:10367:x1875740702337536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845887.460870:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:10367:x1875740702337536:12345-0@lo:502:llog_process_th.0 Request processed in 169us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.460879:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788845887.461661:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451890780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.461853:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10367:1875740702337536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845887.462004:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845887.462016:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845887.462019:0:10367:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788845887.462026:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788845887.462068:0:10367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10367:1875740702337664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845887.462137:0:10367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.462177:0:10367:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e34278d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.462363:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702337664 00000100:00100000:2.0:1788845887.462378:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702337664 00000100:00100000:2.0:1788845887.462431:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788845887.462439:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:10367:x1875740702337664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.462603:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:10367:x1875740702337664:12345-0@lo:502:llog_process_th.0 Request processed in 164us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.462611:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788845887.462704:0:10367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10367:1875740702337664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788845887.462730:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845887.462737:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845887.462739:0:10367:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788845887.462744:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788845887.463014:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788845887.463044:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788845887.463055:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.463068:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845887.463079:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788845887.463089:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e451417000 from 48 10000000:01000000:0.0:1788845887.463093:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788845887.463124:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.463132:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.463144:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.463162:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.463199:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.463234:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451890780 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.463282:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702337792 00000100:00100000:1.0:1788845887.463288:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702337792 00000100:00100000:1.0:1788845887.463325:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788845887.463333:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702337792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845887.463344:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845887.463360:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2200/0x21b4d561382719c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382719be expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.463385:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2200/0x21b4d561382719c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382719be expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.463395:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2200/0x21b4d561382719c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382719be expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.463417:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2200, rc 0) 00000100:00100000:1.0:1788845887.463458:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702337792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.463464:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788845887.463606:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845887.463621:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.463630:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.463685:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.463711:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.463770:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451890780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.463866:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702337920 00000100:00100000:2.0:1788845887.463871:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702337920 00000100:00100000:2.0:1788845887.464012:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788845887.464022:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702337920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.464200:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702337920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.464208:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788845887.464269:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702337920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.464299:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702338048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.464339:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.464390:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e451890780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.464427:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702338048 00000100:00100000:2.0:1788845887.464432:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702338048 00000100:00100000:2.0:1788845887.464485:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788845887.464492:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702338048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.464604:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702338048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.464610:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788845887.464696:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702338048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.465018:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10369:1875740702338176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845887.465053:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.465079:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.465130:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702338176 00000100:00100000:2.0:1788845887.465134:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702338176 00000100:00100000:2.0:1788845887.465163:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788845887.465170:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:10369:x1875740702338176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.465247:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:10369:x1875740702338176:12345-0@lo:502:llog_process_th.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.465262:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788845887.465293:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10369:1875740702338176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.465327:0:10369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10369:1875740702338304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.465353:0:10369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.465368:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702338304 00000100:00100000:2.0:1788845887.465371:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702338304 00000100:00100000:2.0:1788845887.465384:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788845887.465389:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:10369:x1875740702338304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.465435:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:10369:x1875740702338304:12345-0@lo:502:llog_process_th.0 Request processed in 45us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.465441:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788845887.465463:0:10369:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.465471:0:10369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10369:1875740702338304:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788845887.465487:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788845887.465671:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788845887.465689:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788845887.465701:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.465711:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845887.465721:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788845887.465723:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788845887.465726:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788845887.465750:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.465757:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.465766:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.465778:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702338432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.465805:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.465827:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.465840:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702338432 00000100:00100000:0.0:1788845887.465843:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702338432 00000100:00100000:0.0:1788845887.465867:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788845887.465871:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702338432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845887.465879:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845887.465972:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0de00/0x21b4d561382719d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382719cc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.465996:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0de00/0x21b4d561382719d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382719cc expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.466006:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0de00/0x21b4d561382719d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382719cc expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.466014:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0de00, rc 0) 00000100:00100000:0.0:1788845887.466043:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702338432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.466049:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788845887.466077:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702338432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845887.466093:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.466103:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.466154:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702338560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.466177:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.466193:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469bf56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.466321:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702338560 00000100:00100000:2.0:1788845887.466325:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702338560 00000100:00100000:2.0:1788845887.466769:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788845887.466779:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702338560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.466921:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702338560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.466928:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788845887.467078:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702338560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.467127:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702338688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.467328:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845887.467366:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.467557:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702338688 00000100:00100000:0.0:1788845887.467564:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702338688 00000100:00100000:0.0:1788845887.467610:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788845887.467618:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702338688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.467720:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702338688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.467727:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788845887.467768:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702338688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.468009:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10370:1875740702338816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845887.468050:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.468081:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63180 going to sleep for 11 seconds 00000100:00100000:1.0:1788845887.468256:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702338816 00000100:00100000:1.0:1788845887.468262:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702338816 00000100:00100000:1.0:1788845887.468288:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788845887.468295:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:10370:x1875740702338816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.468573:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10370:1875740702338816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845887.468600:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1788845887.468639:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:10370:x1875740702338816:12345-0@lo:502:llog_process_th.0 Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.468651:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000020:00000080:0.0:1788845887.468704:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845887.468708:0:10370:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788845887.468716:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788845887.468745:0:10370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10370:1875740702338944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845887.468780:0:10370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.468808:0:10370:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.468979:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702338944 00000100:00100000:2.0:1788845887.468991:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702338944 00000100:00100000:2.0:1788845887.469031:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788845887.469038:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:10370:x1875740702338944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845887.469127:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:10370:x1875740702338944:12345-0@lo:502:llog_process_th.0 Request processed in 90us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.469134:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788845887.469163:0:10370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10370:1875740702338944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788845887.469327:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845887.469335:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845887.469337:0:10370:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788845887.469341:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788845887.469595:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788845887.469623:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788845887.469634:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.469646:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845887.469658:0:6513:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788845887.469662:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90e450c6cd28 from 1 10000000:01000000:0.0:1788845887.469665:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788845887.469696:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.469715:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.469727:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.469743:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702339072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845887.469777:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.469838:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.470498:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702339072 00000100:00100000:2.0:1788845887.470508:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702339072 00000100:00100000:2.0:1788845887.470602:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788845887.470609:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702339072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845887.470632:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845887.470651:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42ce00/0x21b4d561382719e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382719da expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.470681:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42ce00/0x21b4d561382719e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382719da expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.470693:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42ce00/0x21b4d561382719e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382719da expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.470702:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42ce00, rc 0) 00000100:00100000:2.0:1788845887.470770:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702339072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.470776:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788845887.470920:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702339072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845887.470939:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.470982:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.471069:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702339200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845887.471106:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845887.471146:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845887.472021:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702339200 00000100:00100000:2.0:1788845887.472031:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702339200 00000100:00100000:2.0:1788845887.472072:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788845887.472083:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702339200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845887.472246:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702339200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (1126us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788845887.472255:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788845887.472398:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702339200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788845887.472447:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788845887.472457:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.472467:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788845887.663970:0:10388:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe62f34530 20000000:00000080:3.0:1788845887.663989:0:10388:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e47f407800 uarg=0000000000000000 20000000:01000000:3.0:1788845887.664037:0:10388:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788845887.664044:0:10388:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788845887.664048:0:10388:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788845887.668661:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788845887.671763:0:10388:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788845887.675897:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788845887.675997:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788845887.676017:0:10388:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788845887.676033:0:10388:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788845887.676054:0:10388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676072:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e4536e6e00/0x21b4d56138271684 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827167d expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676081:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d5613827168b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676109:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382716df expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676116:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271805 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676126:0:10388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676133:0:10388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676171:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676186:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 9 pid: 6508 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.676203:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339328:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788845887.676370:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271805 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676379:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271805 expref: 23 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.676388:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339456:0@lo:104: 00000100:00100000:1.0:1788845887.676425:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845887.676506:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382716df expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.676561:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382716df expref: 23 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.676570:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339584:0@lo:104: 00000100:00100000:1.0:1788845887.676595:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845887.677192:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827168b expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.677202:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827168b expref: 23 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.677210:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339712:0@lo:104: 00010000:00010000:1.0:1788845887.677236:0:10388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e4536e6e00/0x21b4d56138271684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d5613827167d expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.677244:0:10388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e4536e6e00/0x21b4d56138271684 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d5613827167d expref: 23 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.677251:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339840:0@lo:104: 00000100:00100000:1.0:1788845887.677266:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845887.677370:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788845887.677444:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.677457:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845887.677465:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702339456 00000100:00100000:0.0:1788845887.677471:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702339456 00000100:00100000:0.0:1788845887.677506:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702339584 00000100:00100000:0.0:1788845887.677509:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702339584 00000100:00100000:0.0:1788845887.677517:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702339712 00000100:00100000:0.0:1788845887.677535:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702339712 00000100:00100000:0.0:1788845887.677545:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702339840 00000100:00100000:0.0:1788845887.677547:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702339840 00000100:00100000:0.0:1788845887.677558:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845887.677565:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:10388:x1875740702339456:12345-0@lo:104: 00010000:00010000:0.0:1788845887.677577:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.677637:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845887.677643:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:10388:x1875740702339456:12345-0@lo:104: Request processed in 79us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.677650:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845887.677673:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788845887.677678:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f499050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:10388:x1875740702339584:12345-0@lo:104: 00010000:00010000:0.0:1788845887.677686:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.677718:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788845887.677723:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f499050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:10388:x1875740702339584:12345-0@lo:104: Request processed in 46us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.677729:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788845887.677753:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845887.677758:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:10388:x1875740702339712:12345-0@lo:104: 00010000:00010000:0.0:1788845887.677765:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.677791:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788845887.677796:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:10388:x1875740702339712:12345-0@lo:104: Request processed in 38us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.677801:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845887.677810:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788845887.677815:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:10388:x1875740702339840:12345-0@lo:104: 00010000:00010000:0.0:1788845887.677822:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.677845:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788845887.677849:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:10388:x1875740702339840:12345-0@lo:104: Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845887.677855:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788845887.677896:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788845887.677902:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.677911:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788845887.677914:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678025:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788845887.678033:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678041:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788845887.678044:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678051:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845887.678059:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845887.678064:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845887.678089:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678095:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845887.678112:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678119:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c200/0x21b4d561382716df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382716e6 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678132:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788845887.678136:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678146:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788845887.678149:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678156:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845887.678162:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845887.678167:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845887.678179:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678185:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845887.678190:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678196:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d5613827168b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271692 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678204:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788845887.678207:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678212:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4536e6a00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788845887.678215:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678229:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788845887.678236:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845887.678241:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788845887.678252:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678257:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788845887.678270:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678276:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4536e6a00/0x21b4d5613827167d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271684 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678285:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845887.678287:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845887.678288:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845887.678299:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702339968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845887.678329:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.678355:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845887.678361:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702340096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845887.678392:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.678419:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702340224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845887.678439:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.678465:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702339968 00000100:00100000:2.0:1788845887.678475:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702339968 00010000:00010000:2.0:1788845887.678495:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382716df expref: 24 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.678509:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702340096 00000100:00100000:2.0:1788845887.678512:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702340096 00010000:00010000:2.0:1788845887.678544:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827168b expref: 25 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.678557:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702340224 00000100:00100000:2.0:1788845887.678561:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702340224 00010000:00010000:2.0:1788845887.678573:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e4536e6e00/0x21b4d56138271684 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827167d expref: 26 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.678584:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788845887.678590:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+26:3642:x1875740702339968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845887.678599:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845887.678605:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382716df expref: 26 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678613:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382716df expref: 26 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678626:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845887.678653:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+26:3642:x1875740702339968:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.678659:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788845887.678674:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788845887.678680:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+25:3642:x1875740702340096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845887.678687:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845887.678696:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827168b expref: 25 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678704:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827168b expref: 25 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678713:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845887.678735:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+25:3642:x1875740702340096:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.678741:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788845887.678752:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788845887.678758:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702340224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845887.678765:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845887.678769:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e4536e6e00/0x21b4d56138271684 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d5613827167d expref: 24 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678776:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e4536e6e00/0x21b4d56138271684 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d5613827167d expref: 24 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.678785:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845887.678808:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702340224:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.678814:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788845887.678847:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702340096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845887.678855:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702339968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845887.678877:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702340224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845887.679041:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845887.679052:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845887.679057:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845887.679073:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.679079:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845887.679099:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.679105:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064400/0x21b4d56138271805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d5613827180c expref: -99 pid: 9507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845887.679118:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845887.679120:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845887.679122:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845887.679129:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845887.679216:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339456:0@lo:104: 00010000:00010000:1.0:1788845887.679227:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e440031800/0x21b4d561382716e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382716df expref: 23 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.679239:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339584:0@lo:104: 00010000:00010000:1.0:1788845887.679246:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065000/0x21b4d56138271692 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827168b expref: 22 pid: 6508 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.679265:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339712:0@lo:104: 00010000:00010000:1.0:1788845887.679276:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e6e00/0x21b4d56138271684 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d5613827167d expref: 21 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.679283:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339840:0@lo:104: 00000100:00100000:2.0:1788845887.679329:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702340352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788845887.679364:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845887.679882:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:3.0:1788845887.680070:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10388:1875740702339328:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788845887.680096:0:10388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845887.680137:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702340352 00000100:00100000:0.0:1788845887.680143:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702340352 00010000:00010000:1.0:1788845887.680224:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271805 expref: 21 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845887.680293:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788845887.680300:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:3641:x1875740702340352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788845887.680310:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845887.680314:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271805 expref: 21 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.680322:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271805 expref: 21 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.680335:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42cc00/0x21b4d5613827180c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271805 expref: 21 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845887.680345:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845887.680388:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3641:x1875740702340352:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845887.680393:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845887.680448:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702340352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845887.681007:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845887.681044:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683409792 00000100:00100000:2.0:1788845887.681049:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683409792 00010000:00010000:2.0:1788845887.681069:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 10 pid: 6508 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.681165:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1788845887.681174:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683409792:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788845887.681184:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845887.681188:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 10 pid: 6508 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681198:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 10 pid: 6508 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681210:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271924 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543ee expref: 10 pid: 6508 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681222:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681230:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681245:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681252:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681269:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681276:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681282:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788845887.681286:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681294:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681313:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845887.681324:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845887.681332:0:10388:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.681339:0:10388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845887.681344:0:10388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e3000/0x21b4d561382719e8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845887.681367:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:2399:x1875740683409792:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 195us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.681374:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1788845887.802586:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702340480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845887.802652:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.802700:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845887.802706:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702340608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788845887.802726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845887.802766:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702340480 00000100:00100000:2.0:1788845887.802773:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702340480 00000100:00100000:2.0:1788845887.802814:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702340608 00000100:00100000:2.0:1788845887.802826:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702340608 00000100:00100000:2.0:1788845887.802846:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788845887.802853:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702340480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845887.802879:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845887.802919:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702340480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (267us total) trans 0 rc 0/0 00000100:00080000:3.0:1788845887.803028:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845887.803888:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788845887.803911:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788845887.803922:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702340608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788845887.804013:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845887.804076:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702340608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845887.804082:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788845887.804119:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343935c00 x1875740702340608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845887.804137:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702340608:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788845887.804148:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343937b80 x1875740702340480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845887.804158:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702340480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845888.314061:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702341120:0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845888.314182:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702341632:0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314209:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845888.314235:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702342144:0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314255:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845888.314279:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788845888.314286:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702340992:0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314307:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845888.314323:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702341504:0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314342:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845888.314358:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702342016:0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845888.314404:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702341120 00000100:00100000:3.0:1788845888.314411:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702341120 00000100:00100000:3.0:1788845888.314453:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702341504 00000100:00100000:3.0:1788845888.314456:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702341504 00000100:00100000:3.0:1788845888.314487:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702342016 00000100:00100000:3.0:1788845888.314490:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702342016 00000100:00100000:3.0:1788845888.314508:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788845888.314516:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702341120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702341120:12345-0@lo:400:kworker.0 Request processed in 91us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845888.314614:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788845888.314630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788845888.314636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702341504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314662:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702341504:12345-0@lo:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845888.314668:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788845888.314679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845888.314685:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702342016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.314711:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702342016:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845888.314716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788845888.314734:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702341632 00000100:00100000:3.0:1788845888.314737:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702341632 00000100:00100000:3.0:1788845888.314757:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702342144 00000100:00100000:3.0:1788845888.314760:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702342144 00000100:00100000:1.0:1788845888.314967:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702340992 00000100:00100000:1.0:1788845888.314971:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702340992 00000100:00100000:1.0:1788845888.315001:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788845888.315008:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702340992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845888.315053:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702340992:12345-0@lo:400:kworker.0 Request processed in 45us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845888.315059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788845888.315082:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788845888.315089:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702341632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845888.315117:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702341632:12345-0@lo:400:kworker.0 Request processed in 29us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845888.315122:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788845888.315134:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788845888.315140:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702342144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845888.315164:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702342144:12345-0@lo:400:kworker.0 Request processed in 25us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845888.315169:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788845888.315238:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845888.315356:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702340736:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.315391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845888.315428:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702341248:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.315452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845888.315468:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702341760:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.315496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845888.315510:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702342272:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.315550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845888.315565:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788845888.315572:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702340864:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.315593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845888.315611:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702341376:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.315630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845888.315641:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702341888:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.315657:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845888.315664:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702342400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845888.315680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788845888.315718:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845888.315724:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788845888.315734:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702340864 00000100:00100000:2.0:1788845888.315738:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702340864 00000100:00100000:2.0:1788845888.315759:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702341376 00000100:00100000:2.0:1788845888.315761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702341376 00000100:00100000:1.0:1788845888.315944:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702340736 00000100:00100000:1.0:1788845888.315958:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702340736 00000100:00100000:1.0:1788845888.315991:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788845888.316002:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3640:x1875740702340736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845888.316043:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3640:x1875740702340736:12345-0@lo:400:kworker.0 Request processed in 41us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845888.316050:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788845888.316075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702341248 00000100:00100000:1.0:1788845888.316079:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702341248 00000100:00100000:1.0:1788845888.316093:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702342400 00000100:00100000:1.0:1788845888.316095:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702342400 00000100:00100000:1.0:1788845888.316106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845888.316112:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702341248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845888.316149:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702341248:12345-0@lo:400:kworker.0 Request processed in 37us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845888.316155:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845888.316166:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845888.316172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702342400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788845888.316196:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845888.316223:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702342400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845888.316229:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845888.316247:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702341888 00000100:00100000:1.0:1788845888.316250:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702341888 00000100:00100000:2.0:1788845888.316287:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788845888.316295:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702340864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.316324:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702340864:12345-0@lo:400:kworker.0 Request processed in 31us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845888.316330:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845888.316383:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702341760 00000100:00100000:3.0:1788845888.316387:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702341760 00000100:00100000:3.0:1788845888.316404:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702342272 00000100:00100000:3.0:1788845888.316406:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702342272 00000100:00100000:3.0:1788845888.316422:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788845888.316428:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702341760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.316460:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702341760:12345-0@lo:400:kworker.0 Request processed in 33us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845888.316472:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788845888.316483:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788845888.316489:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702342272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.316532:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343937100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702342272:12345-0@lo:400:kworker.0 Request processed in 28us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845888.316538:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788845888.316572:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788845888.316579:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702341376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845888.316620:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702341376:12345-0@lo:400:kworker.0 Request processed in 42us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845888.316626:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788845888.320750:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845888.320761:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845888.320822:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702340992:0@lo:400:kworker.0 00010000:00080000:0.0:1788845888.320842:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438ea680 x1875740702341504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845888.320853:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702341504:0@lo:400:kworker.0 00010000:00080000:0.0:1788845888.320865:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e9c00 x1875740702342016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845888.320872:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702342016:0@lo:400:kworker.0 00000100:00100000:0.0:1788845888.320885:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702341120:0@lo:400:kworker.0 00010000:00080000:0.0:1788845888.320896:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438eaa00 x1875740702341632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845888.320903:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702341632:0@lo:400:kworker.0 00010000:00080000:0.0:1788845888.320913:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e9500 x1875740702342144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845888.320920:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702342144:0@lo:400:kworker.0 00000100:00100000:1.0:1788845888.323598:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788845888.323622:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702341888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845888.324474:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702340864:0@lo:400:kworker.0 00000100:00100000:1.0:1788845888.325579:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702341888:12345-0@lo:400:kworker.0 Request processed in 1965us (9915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845888.325593:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788845888.325614:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702341376:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.327137:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702341888:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.327163:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702342400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845888.327194:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702340736:0@lo:400:kworker.0 00000100:00100000:2.0:1788845888.327205:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702341248:0@lo:400:kworker.0 00010000:00080000:2.0:1788845888.327219:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438ebb80 x1875740702341760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845888.327229:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702341760:0@lo:400:kworker.0 00010000:00080000:2.0:1788845888.327242:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438eb100 x1875740702342272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845888.327249:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702342272:0@lo:400:kworker.0 00000100:00100000:0.0:1788845888.825865:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845888.825899:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702342528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788845888.826007:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845888.826102:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702342528 00000100:00100000:0.0:1788845888.826111:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702342528 00000100:00100000:0.0:1788845888.826169:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788845888.826180:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702342528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788845888.826218:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845888.826274:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702342528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845888.826281:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788845888.826345:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1c00 x1875740702342528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845888.826368:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702342528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788845888.826770:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702342656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845888.826799:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845888.826912:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702342656 00000100:00100000:1.0:1788845888.826917:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702342656 00000100:00100000:1.0:1788845888.826955:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788845888.826963:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702342656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845888.826976:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845888.827019:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702342656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845888.827026:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788845888.828957:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a7b80 x1875740702342656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845888.828991:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702342656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845889.264931:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845889.265656:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683409920 00000100:00100000:0.0:1788845889.265672:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683409920 00000100:00100000:0.0:1788845889.265743:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:0.0:1788845889.265756:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:6169:x1875740683409920:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845889.265779:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845889.265804:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754434 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845889.265842:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845889.265880:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845889.265891:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0da00, rc 0) 00000100:00100000:0.0:1788845889.265986:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6169:x1875740683409920:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 232us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845889.265993:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:0.0:1788845889.272388:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845889.273591:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683410048 00000100:00100000:1.0:1788845889.273811:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683410048 00000100:00100000:1.0:1788845889.273901:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:1.0:1788845889.273924:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6169:x1875740683410048:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.274143:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6169:x1875740683410048:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 231us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845889.274152:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:3.0:1788845889.277866:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845889.278131:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683410176 00000100:00100000:1.0:1788845889.278146:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683410176 00000100:00100000:1.0:1788845889.278222:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:1.0:1788845889.278234:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6169:x1875740683410176:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.278411:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6169:x1875740683410176:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 178us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845889.278419:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:1.0:1788845889.291547:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845889.291973:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683410304 00000100:00100000:3.0:1788845889.291987:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683410304 00000100:00100000:3.0:1788845889.292073:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:3.0:1788845889.292085:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6704:x1875740683410304:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845889.292277:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6704:x1875740683410304:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 193us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845889.292287:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:1.0:1788845889.300046:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845889.300309:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683410432 00000100:00100000:3.0:1788845889.300324:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683410432 00000100:00100000:3.0:1788845889.300405:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:3.0:1788845889.300419:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6704:x1875740683410432:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845889.300828:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:6704:x1875740683410432:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 410us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845889.301282:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 254 00010000:00010000:0.0:1788845889.342271:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788845889.657599:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845889.657610:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e342932800 from 4 10000000:01000000:1.0:1788845889.657616:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845889.657683:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845889.657697:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845889.657713:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845889.657747:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702342784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.657876:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845889.658024:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.658171:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702342784 00000100:00100000:2.0:1788845889.658183:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702342784 00000100:00100000:2.0:1788845889.658262:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788845889.658274:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702342784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845889.658291:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845889.658310:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d561382719f6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.658342:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d561382719f6 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.658357:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382719f6 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.658368:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42dc00, rc 0) 00000100:00100000:2.0:1788845889.658471:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702342784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.658491:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788845889.665666:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702342784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845889.665706:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845889.665722:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845889.666153:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702342912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.666242:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845889.666334:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845889.666457:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702342912 00000100:00100000:3.0:1788845889.666467:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702342912 00000100:00100000:2.0:1788845889.666568:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788845889.666583:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702342912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.666773:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702342912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.666782:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788845889.666888:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702342912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.666925:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702343040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.666992:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845889.667020:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.667127:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702343040 00000100:00100000:2.0:1788845889.667131:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702343040 00000100:00100000:2.0:1788845889.667166:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788845889.667175:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702343040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.667327:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702343040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.667334:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788845889.667431:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702343040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845889.668313:0:10467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10467:1875740702343168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845889.668382:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845889.668435:0:10467:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457540 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.668459:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702343168 00000100:00100000:2.0:1788845889.668466:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702343168 00000100:00100000:2.0:1788845889.668516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788845889.668561:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:10467:x1875740702343168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845889.668668:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:10467:x1875740702343168:12345-0@lo:502:llog_process_th.0 Request processed in 109us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.668676:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788845889.668694:0:10467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10467:1875740702343168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845889.668724:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845889.668737:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845889.668740:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788845889.668750:0:10467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e342932800 00000020:00000080:3.0:1788845889.668752:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845889.668855:0:10467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10467:1875740702343296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845889.668907:0:10467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845889.669229:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702343296 00000100:00100000:3.0:1788845889.669235:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702343296 00000100:00100000:3.0:1788845889.669271:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788845889.669278:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:10467:x1875740702343296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845889.669371:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:10467:x1875740702343296:12345-0@lo:502:llog_process_th.0 Request processed in 93us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845889.669378:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788845889.669432:0:10467:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e460457540 going to sleep for 11 seconds 00000100:00100000:3.0:1788845889.669446:0:10467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10467:1875740702343296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845889.669470:0:10467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845889.669476:0:10467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845889.669484:0:10467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788845889.669488:0:10467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788845889.671476:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788845889.671543:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788845889.671559:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845889.671574:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845889.671587:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845889.671608:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451767800 from 4 10000000:01000000:1.0:1788845889.671612:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845889.671659:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845889.671669:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845889.671682:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845889.671716:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702343424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.672158:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845889.672211:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702343424 00000100:00100000:1.0:1788845889.672214:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.672222:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702343424 00000100:00100000:2.0:1788845889.672286:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788845889.672297:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702343424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845889.672313:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845889.672338:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271a04 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.672374:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271a04 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.672387:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a04 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.672397:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d000, rc 0) 00000100:00100000:2.0:1788845889.672446:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702343424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.672453:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788845889.673048:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702343424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845889.673071:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845889.673083:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845889.673171:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702343552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.673211:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845889.673245:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845889.673465:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702343552 00000100:00100000:3.0:1788845889.673472:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702343552 00000100:00100000:3.0:1788845889.673577:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788845889.673586:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702343552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845889.673739:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702343552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845889.673748:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788845889.674145:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702343552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.674190:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702343680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.674244:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845889.674275:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.674287:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702343680 00000100:00100000:2.0:1788845889.674292:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702343680 00000100:00100000:2.0:1788845889.674330:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788845889.674338:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702343680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.674446:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702343680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.674453:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788845889.674503:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702343680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.674737:0:10468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10468:1875740702343808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845889.674774:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845889.674792:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702343808 00000100:00100000:2.0:1788845889.674796:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702343808 00000100:00100000:2.0:1788845889.674813:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788845889.674819:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:10468:x1875740702343808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845889.676101:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:10468:x1875740702343808:12345-0@lo:502:llog_process_th.0 Request processed in 1271us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.676114:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788845889.676178:0:10468:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342968b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.676202:0:10468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10468:1875740702343808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845889.676239:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845889.676252:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845889.676255:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788845889.676262:0:10468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e451767800 00000020:00000080:2.0:1788845889.676265:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845889.676384:0:10468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10468:1875740702343936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845889.676433:0:10468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845889.676459:0:10468:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342968b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788845889.681184:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702343936 00000100:00100000:3.0:1788845889.681203:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702343936 00000100:00100000:3.0:1788845889.681270:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788845889.681283:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:10468:x1875740702343936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845889.681495:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:10468:x1875740702343936:12345-0@lo:502:llog_process_th.0 Request processed in 214us (5061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845889.681505:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788845889.682202:0:10468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10468:1875740702343936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845889.682252:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845889.682262:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845889.682265:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788845889.682269:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788845889.682497:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788845889.682551:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845889.682565:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845889.682579:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845889.682592:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788845889.682596:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47518c000 from 4 10000000:01000000:3.0:1788845889.682599:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845889.682643:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845889.682661:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845889.682673:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845889.682699:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845889.682760:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845889.682796:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d196000 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.682876:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702344064 00000100:00100000:2.0:1788845889.682884:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702344064 00000100:00100000:2.0:1788845889.682929:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788845889.682947:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702344064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845889.682961:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845889.682977:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271a12 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.683002:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271a12 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.683021:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a12 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.683032:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c800, rc 0) 00000100:00100000:2.0:1788845889.683077:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702344064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.683084:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788845889.683121:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845889.683134:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.683144:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845889.683201:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.683227:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845889.683240:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3429683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.683253:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702344192 00000100:00100000:2.0:1788845889.683257:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702344192 00000100:00100000:2.0:1788845889.683279:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788845889.683286:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702344192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.683414:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702344192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.683421:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788845889.686952:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845889.687052:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845889.687163:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845889.687213:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.687546:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702344320 00000100:00100000:2.0:1788845889.687555:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702344320 00000100:00100000:2.0:1788845889.687634:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788845889.687645:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702344320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.687793:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702344320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.687802:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788845889.687907:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845889.689215:0:10471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10471:1875740702344448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845889.689299:0:10471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845889.689352:0:10471:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845889.690999:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702344448 00000100:00100000:1.0:1788845889.691016:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702344448 00000100:00100000:1.0:1788845889.691092:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788845889.691103:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:10471:x1875740702344448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845889.691308:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:10471:x1875740702344448:12345-0@lo:502:llog_process_th.0 Request processed in 206us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845889.691315:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788845889.691390:0:10471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10471:1875740702344448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788845889.691434:0:10471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845889.691445:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845889.691448:0:10471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788845889.691456:0:10471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e47518c000 00000020:00000080:1.0:1788845889.691458:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845889.692675:0:10471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10471:1875740702344576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845889.692767:0:10471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845889.692809:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702344576 00000100:00100000:2.0:1788845889.692817:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702344576 00000100:00100000:2.0:1788845889.692880:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788845889.692890:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:10471:x1875740702344576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845889.693033:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:10471:x1875740702344576:12345-0@lo:502:llog_process_th.0 Request processed in 145us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.693042:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788845889.693097:0:10471:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3429683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.693119:0:10471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10471:1875740702344576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845889.693150:0:10471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845889.693158:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845889.693160:0:10471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788845889.693164:0:10471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788845889.693241:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788845889.693264:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845889.693277:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.693289:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845889.693315:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845889.693318:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451417000 from 4 10000000:01000000:2.0:1788845889.693321:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845889.693350:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.693359:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.693370:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845889.693384:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.693412:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845889.693428:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4751986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.693443:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702344704 00000100:00100000:2.0:1788845889.693446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702344704 00000100:00100000:2.0:1788845889.693470:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788845889.693477:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702344704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845889.693500:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845889.693515:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271a20 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.693566:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271a20 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.693580:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a20 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.693602:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c600, rc 0) 00000100:00100000:2.0:1788845889.693635:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702344704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.693641:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788845889.693674:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845889.693688:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845889.693699:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845889.693758:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.693784:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845889.693796:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4751986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.693808:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702344832 00000100:00100000:2.0:1788845889.693811:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702344832 00000100:00100000:2.0:1788845889.693831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788845889.693837:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702344832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.693960:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702344832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.693966:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788845889.693997:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.694022:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.694057:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845889.694076:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3429683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.694087:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702344960 00000100:00100000:2.0:1788845889.694090:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702344960 00000100:00100000:2.0:1788845889.694110:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788845889.694115:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702344960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845889.694186:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702344960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.694193:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788845889.694230:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702344960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845889.696329:0:10472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10472:1875740702345088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845889.696440:0:10472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845889.696489:0:10472:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4518ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845889.701060:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702345088 00000100:00100000:2.0:1788845889.701084:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702345088 00000100:00100000:2.0:1788845889.701181:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788845889.701195:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:10472:x1875740702345088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845889.701434:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:10472:x1875740702345088:12345-0@lo:502:llog_process_th.0 Request processed in 241us (4992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845889.701443:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788845889.702096:0:10472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10472:1875740702345088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788845889.702147:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788845889.702160:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845889.702163:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788845889.702170:0:10472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e451417000 00000020:00000080:1.0:1788845889.702173:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788845889.702682:0:10472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10472:1875740702345216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845889.702754:0:10472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845889.702795:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702345216 00000100:00100000:1.0:1788845889.702802:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702345216 00000100:00100000:1.0:1788845889.702847:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788845889.702856:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:10472:x1875740702345216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845889.703598:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:10472:x1875740702345216:12345-0@lo:502:llog_process_th.0 Request processed in 737us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845889.703608:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788845889.703675:0:10472:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788845889.703697:0:10472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:10472:1875740702345216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788845889.703727:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788845889.703735:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788845889.703738:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788845889.703742:0:10472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788845889.705617:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788845889.705663:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845889.705678:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845889.705694:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845890.362024:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702345344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788845890.362118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845890.362239:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702345344 00000100:00100000:3.0:1788845890.362250:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702345344 00000100:00100000:3.0:1788845890.362310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788845890.362320:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702345344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788845890.362361:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00010000:00010000:0.0:1788845890.362476:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845890.364040:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702345344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1709us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845890.364056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788845890.364065:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702345344:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788845891.387272:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845891.442872:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845891.442918:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845891.442955:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845891.442980:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845891.442999:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845891.443344:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683410560 00000100:00100000:1.0:1788845891.443353:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683410560 00000100:00100000:3.0:1788845891.444232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683410688 00000100:00100000:3.0:1788845891.444240:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683410688 00000100:00100000:3.0:1788845891.444300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683410816 00000100:00100000:3.0:1788845891.444304:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683410816 00000100:00100000:3.0:1788845891.444331:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:3.0:1788845891.444352:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683410688:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845891.444426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683410688:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 78us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845891.444444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:3.0:1788845891.444462:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1788845891.444469:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683410816:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845891.444494:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683410816:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845891.444500:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:3.0:1788845891.444538:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683410944 00000100:00100000:3.0:1788845891.444541:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683410944 00000100:00100000:3.0:1788845891.444566:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683411072 00000100:00100000:3.0:1788845891.444570:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683411072 00000100:00100000:3.0:1788845891.444587:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788845891.444593:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683410944:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845891.444620:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683410944:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845891.444626:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788845891.444637:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1788845891.444644:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683411072:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845891.444665:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683411072:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845891.444672:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00080000:0.0:1788845891.445303:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845891.445307:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845891.445310:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845891.445312:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845891.447182:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 275 00000100:00100000:1.0:1788845891.447196:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683410560:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845891.447264:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683410560:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 73us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845891.447272:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 275 00010000:00010000:0.0:1788845892.409709:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845892.921689:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702345472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845892.921758:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845892.921839:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702345472 00000100:00100000:2.0:1788845892.921847:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702345472 00000100:00100000:1.0:1788845892.921871:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845892.921884:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702345600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788845892.921906:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788845892.921929:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702345472:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845892.921937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788845892.921962:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845892.922013:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702345472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845892.922026:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788845892.922041:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702345600 00000100:00100000:2.0:1788845892.922044:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702345600 00000100:00100000:2.0:1788845892.922059:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788845892.922065:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702345600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788845892.922074:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845892.922103:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702345600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845892.922109:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788845892.922140:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845892.922189:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a5f80 x1875740702345600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845892.922207:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702345600:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788845892.922361:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343937480 x1875740702345472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845892.922380:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702345472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845893.433830:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702345728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845893.433910:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.434003:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702345728 00000100:00100000:2.0:1788845893.434011:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702345728 00000100:00100000:2.0:1788845893.434056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788845893.434066:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702345728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788845893.434097:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788845893.434142:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702345728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.434150:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788845893.434194:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702345728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845893.434386:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702345984:0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.434420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.434440:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702346496:0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.434461:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.434488:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702347008:0@lo:400:kworker.0 00000100:00100000:3.0:1788845893.434497:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702345856:0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.434508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845893.434550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.434550:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702345984 00000100:00100000:2.0:1788845893.434553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702345984 00000100:00100000:3.0:1788845893.434578:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702346368:0@lo:400:kworker.0 00000100:00100000:3.0:1788845893.434600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845893.434813:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702345856 00000100:00100000:0.0:1788845893.434818:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702345856 00000100:00100000:0.0:1788845893.434852:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788845893.434860:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702345856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845893.434873:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702346880:0@lo:400:kworker.0 00000100:00100000:3.0:1788845893.434892:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845893.434893:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702345856:12345-0@lo:400:kworker.0 Request processed in 35us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845893.434899:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788845893.434951:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702346496 00000100:00100000:2.0:1788845893.434955:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702346496 00000100:00100000:2.0:1788845893.434982:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702347008 00000100:00100000:2.0:1788845893.434985:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702347008 00000100:00100000:2.0:1788845893.434998:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702346368 00000100:00100000:2.0:1788845893.435000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702346368 00000100:00100000:2.0:1788845893.435013:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788845893.435019:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702345984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.435053:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702345984:12345-0@lo:400:kworker.0 Request processed in 34us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.435058:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788845893.435071:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788845893.435076:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702346496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.435101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702346496:12345-0@lo:400:kworker.0 Request processed in 25us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.435106:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788845893.435115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788845893.435121:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702347008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.435144:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702347008:12345-0@lo:400:kworker.0 Request processed in 24us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.435158:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788845893.435169:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788845893.435174:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702346368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.435199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702346368:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.435205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788845893.435229:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845893.435233:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788845893.435243:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702346112:0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.435283:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702345984:0@lo:400:kworker.0 00010000:00080000:2.0:1788845893.435295:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343937480 x1875740702346496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845893.435305:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702346496:0@lo:400:kworker.0 00010000:00080000:2.0:1788845893.435314:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4a80 x1875740702347008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845893.435324:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702347008:0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.435345:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702346240:0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.437646:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.437703:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702346752:0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.437744:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.437766:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702347264:0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.437785:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.437844:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702346240 00000100:00100000:2.0:1788845893.437852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702346240 00000100:00100000:2.0:1788845893.437895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788845893.437903:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702346240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.437967:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702346240:12345-0@lo:400:kworker.0 Request processed in 65us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.437974:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788845893.437997:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702346752 00000100:00100000:2.0:1788845893.438000:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702346752 00000100:00100000:2.0:1788845893.438025:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702347264 00000100:00100000:2.0:1788845893.438028:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702347264 00000100:00100000:2.0:1788845893.438053:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788845893.438059:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702346752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.438088:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702346752:12345-0@lo:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.438095:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788845893.438106:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788845893.438112:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702347264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845893.438135:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702347264:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.438141:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788845893.438164:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845893.438194:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702346240:0@lo:400:kworker.0 00010000:00080000:2.0:1788845893.438208:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c13800 x1875740702346752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845893.438218:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702346752:0@lo:400:kworker.0 00010000:00080000:2.0:1788845893.438227:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4380 x1875740702347264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845893.438243:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702347264:0@lo:400:kworker.0 00010000:00010000:1.0:1788845893.439712:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845893.444570:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702345856:0@lo:400:kworker.0 00000100:00100000:3.0:1788845893.444590:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343934700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702346368:0@lo:400:kworker.0 00000100:00100000:1.0:1788845893.444735:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845893.444769:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702346624:0@lo:400:kworker.0 00000100:00100000:0.0:1788845893.444810:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702346880 00000100:00100000:0.0:1788845893.444817:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702346880 00000100:00100000:1.0:1788845893.444828:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845893.444847:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702347136:0@lo:400:kworker.0 00000100:00100000:1.0:1788845893.444865:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845893.444867:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702346112 00000100:00100000:0.0:1788845893.444870:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702346112 00000100:00100000:0.0:1788845893.444891:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788845893.444905:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702346880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845893.444974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702346880:12345-0@lo:400:kworker.0 Request processed in 75us (10080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845893.445028:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702346880:0@lo:400:kworker.0 00000100:00100000:1.0:1788845893.447483:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788845893.447504:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702346112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845893.447605:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702346112:12345-0@lo:400:kworker.0 Request processed in 110us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845893.447613:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788845893.447771:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788845893.447801:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845893.447844:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702346624 00000100:00100000:0.0:1788845893.447852:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702346624 00000100:00100000:0.0:1788845893.447886:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702347136 00000100:00100000:0.0:1788845893.447902:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702347136 00000100:00100000:0.0:1788845893.447956:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845893.447964:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702346624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845893.448003:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702346624:12345-0@lo:400:kworker.0 Request processed in 40us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845893.448010:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788845893.448022:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788845893.448028:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702347136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845893.448056:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702347136:12345-0@lo:400:kworker.0 Request processed in 29us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845893.448062:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788845893.448079:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845893.448123:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702346112:0@lo:400:kworker.0 00010000:00080000:0.0:1788845893.448140:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c13480 x1875740702346624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845893.448151:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702346624:0@lo:400:kworker.0 00010000:00080000:0.0:1788845893.448162:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4000 x1875740702347136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845893.448170:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702347136:0@lo:400:kworker.0 00000001:02000400:1.0:1788845893.724862:0:10687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788845893.946033:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702347392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845893.946098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.946188:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845893.946195:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702347520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845893.946220:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845893.946248:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702347392 00000100:00100000:2.0:1788845893.946255:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702347392 00000100:00100000:2.0:1788845893.946289:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702347520 00000100:00100000:2.0:1788845893.946291:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702347520 00000100:00100000:2.0:1788845893.946304:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788845893.946313:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702347392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788845893.946339:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845893.946387:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702347392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.946395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788845893.946411:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788845893.946417:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702347520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845893.946427:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845893.946448:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702347520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845893.946454:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788845893.946486:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a7800 x1875740702347520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845893.946503:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702347520:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788845893.946551:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1f80 x1875740702347392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845893.946562:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702347392:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788845894.458853:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845895.481796:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845895.481833:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845895.481854:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702347648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788845895.481937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845895.482060:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702347648 00000100:00100000:3.0:1788845895.482067:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702347648 00000100:00100000:3.0:1788845895.482117:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788845895.482125:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702347648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788845895.482155:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788845895.482203:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702347648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845895.482209:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788845895.482340:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702347648:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788845896.507939:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845896.569818:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845896.569863:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845896.569885:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845896.569918:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845896.569943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845896.569960:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683411456 00000100:00100000:0.0:1788845896.569960:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683411712 00000100:00100000:2.0:1788845896.569970:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683411456 00000100:00100000:0.0:1788845896.569971:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683411712 00000100:00100000:1.0:1788845896.570016:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683411200 00000100:00100000:1.0:1788845896.570022:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683411200 00000100:00100000:2.0:1788845896.570026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683411328 00000100:00100000:0.0:1788845896.570026:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683411584 00000100:00100000:2.0:1788845896.570031:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683411328 00000100:00100000:0.0:1788845896.570031:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683411584 00000100:00100000:2.0:1788845896.570072:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1788845896.570072:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1788845896.570073:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 277 00000100:00100000:2.0:1788845896.570085:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683411456:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845896.570085:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683411712:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845896.570088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683411200:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845896.570154:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683411712:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 70us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845896.570155:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683411200:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 69us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845896.570163:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683411456:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 69us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845896.570169:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1788845896.570174:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 277 00000100:00100000:2.0:1788845896.570175:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1788845896.570190:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1788845896.570193:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1788845896.570197:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683411584:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845896.570199:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683411328:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845896.570224:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683411328:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845896.570224:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683411584:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845896.570232:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1788845896.570232:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00080000:1.0:1788845896.570236:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845896.570243:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845896.570246:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788845896.570248:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788845897.529788:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845898.042486:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845898.042508:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702347776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845898.042598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845898.042657:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702347776 00000100:00100000:0.0:1788845898.042666:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702347776 00000100:00100000:2.0:1788845898.042682:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702347904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788845898.042725:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845898.042736:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702347904 00000100:00100000:0.0:1788845898.042741:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702347904 00000100:00100000:0.0:1788845898.042767:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788845898.042776:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702347776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845898.042861:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845898.043011:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702347776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 234us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845898.043019:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788845898.043042:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788845898.043051:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702347904:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788845898.043058:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4700 x1875740702347776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1788845898.043063:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845898.043082:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702347776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845898.043111:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702347904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845898.043118:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788845898.043123:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a4a80 x1875740702347904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845898.043138:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702347904:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788845898.043189:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788845898.292113:0:10931:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing yml_node 00010000:00010000:0.0:1788845898.554700:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845898.555331:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702348288:0@lo:400:kworker.0 00000100:00100000:1.0:1788845898.555404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845898.555446:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702348800:0@lo:400:kworker.0 00000100:00100000:1.0:1788845898.555469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845898.555490:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702349312:0@lo:400:kworker.0 00000100:00100000:1.0:1788845898.555513:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845898.555637:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788845898.555644:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788845898.555670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845898.555690:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702348672:0@lo:400:kworker.0 00000100:00100000:1.0:1788845898.555711:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845898.555724:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702349184:0@lo:400:kworker.0 00000100:00100000:1.0:1788845898.555755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845898.555785:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702349312 00000100:00100000:1.0:1788845898.555793:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702349312 00000100:00100000:1.0:1788845898.555845:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845898.555866:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702349312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845898.555924:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702349312:12345-0@lo:400:kworker.0 Request processed in 60us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845898.555932:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788845898.555956:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702348160 00000100:00100000:1.0:1788845898.555960:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702348160 00000100:00100000:1.0:1788845898.555982:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788845898.555989:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702348160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845898.556015:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702348160:12345-0@lo:400:kworker.0 Request processed in 28us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845898.556032:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1788845898.556057:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845898.556083:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702348160:0@lo:400:kworker.0 00010000:00080000:1.0:1788845898.556096:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a51880 x1875740702349312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845898.556107:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702349312:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.556350:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702348032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845898.556383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845898.556415:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702348544:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.556437:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845898.556459:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702349056:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.556479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845898.556492:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788845898.556497:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702348416:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.556515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845898.556555:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702348928:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.556575:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845898.556585:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702349440:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.556604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845898.556633:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702348288 00000100:00100000:2.0:1788845898.556637:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702348288 00000100:00100000:2.0:1788845898.556660:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702348800 00000100:00100000:2.0:1788845898.556664:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702348800 00000100:00100000:2.0:1788845898.556695:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702349184 00000100:00100000:2.0:1788845898.556698:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702349184 00000100:00100000:2.0:1788845898.556709:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702348544 00000100:00100000:2.0:1788845898.556712:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702348544 00000100:00100000:2.0:1788845898.556720:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702349056 00000100:00100000:2.0:1788845898.556723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702349056 00000100:00100000:2.0:1788845898.556732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702348928 00000100:00100000:2.0:1788845898.556734:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702348928 00000100:00100000:2.0:1788845898.556745:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788845898.556750:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702348288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.556788:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702348288:12345-0@lo:400:kworker.0 Request processed in 37us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845898.556794:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788845898.556807:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788845898.556814:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702348800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.556842:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702348800:12345-0@lo:400:kworker.0 Request processed in 29us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845898.556951:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702348672 00000100:00100000:0.0:1788845898.556956:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702348672 00000100:00100000:0.0:1788845898.556977:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702348032 00000100:00100000:0.0:1788845898.556980:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702348032 00000100:00100000:0.0:1788845898.556990:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702348416 00000100:00100000:0.0:1788845898.556992:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702348416 00000100:00100000:0.0:1788845898.557004:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788845898.557011:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702348672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845898.557048:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702348672:12345-0@lo:400:kworker.0 Request processed in 38us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845898.557055:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788845898.557067:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788845898.557073:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875740702348032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788845898.557094:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788845898.557127:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875740702348032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845898.557133:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788845898.557144:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788845898.557150:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702348416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845898.557177:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702348416:12345-0@lo:400:kworker.0 Request processed in 28us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845898.557184:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845898.557223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788845898.557238:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788845898.557244:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702349184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.557277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702349184:12345-0@lo:400:kworker.0 Request processed in 33us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845898.557283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788845898.557294:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788845898.557300:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702348544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.557325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702348544:12345-0@lo:400:kworker.0 Request processed in 26us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845898.557341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788845898.557354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788845898.557360:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702349056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.557389:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702349056:12345-0@lo:400:kworker.0 Request processed in 28us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845898.557394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788845898.557404:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788845898.557410:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702348928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.557433:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702348928:12345-0@lo:400:kworker.0 Request processed in 24us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845898.557439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788845898.557480:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702349440 00000100:00100000:2.0:1788845898.557484:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702349440 00000100:00100000:2.0:1788845898.557708:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788845898.557716:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702349440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.557763:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702349440:12345-0@lo:400:kworker.0 Request processed in 48us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845898.557769:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788845898.559167:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845898.559173:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788845898.559176:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845898.559217:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702348672:0@lo:400:kworker.0 00010000:00080000:2.0:1788845898.559236:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a5f80 x1875740702349184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845898.559248:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702349184:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.559271:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702348288:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.559282:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702348800:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.559325:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702348416:0@lo:400:kworker.0 00010000:00080000:2.0:1788845898.559338:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a4a80 x1875740702348928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845898.559346:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702348928:0@lo:400:kworker.0 00010000:00080000:2.0:1788845898.559356:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e342a53800 x1875740702349440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845898.559364:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702349440:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.559380:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702348032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845898.559391:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702348544:0@lo:400:kworker.0 00000100:00100000:2.0:1788845898.559403:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702349056:0@lo:400:kworker.0 00000100:00100000:2.0:1788845899.065753:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702349568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845899.065819:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845899.066025:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702349568 00000100:00100000:2.0:1788845899.066033:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702349568 00000100:00100000:2.0:1788845899.066087:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788845899.066096:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702349568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845899.066127:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845899.066171:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702349568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845899.066190:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788845899.066228:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4000 x1875740702349568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845899.066247:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702349568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845899.066571:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788845899.066582:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702349696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845899.066615:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845899.066746:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702349696 00000100:00100000:0.0:1788845899.066758:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702349696 00000100:00100000:0.0:1788845899.066795:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788845899.066802:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702349696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788845899.066813:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845899.066857:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702349696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845899.066863:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788845899.067115:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3e8000 x1875740702349696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845899.067130:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702349696:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788845899.577784:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845900.601816:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845900.601886:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845900.601908:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702349824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788845900.601978:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845900.602100:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702349824 00000100:00100000:0.0:1788845900.602108:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702349824 00000100:00100000:0.0:1788845900.602160:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788845900.602169:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702349824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788845900.602199:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788845900.602252:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702349824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845900.602260:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788845900.602351:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702349824:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788845901.625754:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845901.689263:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845901.689356:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845901.689390:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845901.689701:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683412096 00000100:00100000:2.0:1788845901.689712:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683412096 00000100:00100000:2.0:1788845901.689769:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683411968 00000100:00100000:2.0:1788845901.689773:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683411968 00000100:00100000:2.0:1788845901.689795:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:2.0:1788845901.689804:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683412096:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845901.689885:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683412096:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 81us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845901.689893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:2.0:1788845901.689910:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:2.0:1788845901.689917:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683411968:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845901.689942:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683411968:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845901.689960:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00080000:2.0:1788845901.689981:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845901.689985:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845901.690168:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845901.690338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845901.695605:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683412224 00000100:00100000:1.0:1788845901.695620:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683412224 00000100:00100000:1.0:1788845901.695690:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683412352 00000100:00100000:1.0:1788845901.695695:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683412352 00000100:00100000:1.0:1788845901.695727:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788845901.695738:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2397:x1875740683412224:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:1.0:1788845901.695773:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271939 00000100:00080000:1.0:1788845901.695783:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90e47f428000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788845901.695823:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788845901.695996:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+2:2397:x1875740683412224:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 259us (5835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845901.696005:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1788845901.696025:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00080000:2.0:1788845901.696083:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845901.696090:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788845901.696746:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845901.697055:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2397:x1875740683412352:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:3.0:1788845901.697096:0:8906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271940 00000100:00080000:3.0:1788845901.697109:0:8906:0:(import.c:65:import_set_state_nolock()) ffff90e47f42d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788845901.697164:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788845901.697341:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475f72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+2:2397:x1875740683412352:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 1303us (7002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845901.697351:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00010000:00010000:3.0:1788845901.697650:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845901.702505:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683411840 00000100:00100000:0.0:1788845901.702565:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683411840 00000100:00100000:0.0:1788845901.702626:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 279 00000100:00100000:0.0:1788845901.702635:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2401:x1875740683411840:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845901.703058:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2401:x1875740683411840:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 422us (13802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845901.703067:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 279 00010000:00010000:0.0:1788845902.655201:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788845902.687840:0:11115:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.105 00000100:00100000:3.0:1788845903.172451:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702349952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845903.172547:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845903.172628:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702349952 00000100:00100000:3.0:1788845903.172636:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702349952 00000100:00100000:3.0:1788845903.172682:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845903.172694:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702349952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845903.172720:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845903.172761:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702349952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845903.172768:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788845903.172786:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845903.172814:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e8000 x1875740702349952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845903.172832:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702349952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845903.173081:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845903.173107:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702350080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788845903.173135:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845903.173244:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702350080 00000100:00100000:1.0:1788845903.173255:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702350080 00000100:00100000:1.0:1788845903.173292:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788845903.173308:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702350080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845903.173318:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845903.173352:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702350080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845903.173357:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788845903.173383:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad7800 x1875740702350080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845903.173396:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702350080:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788845903.173492:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845903.674049:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702350464:0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845903.674172:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702350976:0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845903.674214:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702351488:0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845903.674266:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788845903.674272:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702350592:0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845903.674310:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702351104:0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674330:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845903.674356:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845903.674368:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702350464 00000100:00100000:1.0:1788845903.674373:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702350464 00000100:00100000:1.0:1788845903.674418:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788845903.674426:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702350464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674506:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702350464:12345-0@lo:400:kworker.0 Request processed in 81us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845903.674515:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788845903.674554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702350976 00000100:00100000:1.0:1788845903.674559:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702350976 00000100:00100000:1.0:1788845903.674589:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702350592 00000100:00100000:1.0:1788845903.674602:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702350592 00000100:00100000:1.0:1788845903.674616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702351104 00000100:00100000:1.0:1788845903.674618:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702351104 00000100:00100000:1.0:1788845903.674631:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788845903.674637:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702350976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674669:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702350976:12345-0@lo:400:kworker.0 Request processed in 32us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845903.674674:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788845903.674686:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788845903.674691:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702350592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674716:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702350592:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845903.674722:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788845903.674734:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788845903.674740:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702351104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674762:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702351104:12345-0@lo:400:kworker.0 Request processed in 23us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845903.674768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788845903.674785:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702351488 00000100:00100000:1.0:1788845903.674788:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702351488 00000100:00100000:1.0:1788845903.674813:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788845903.674825:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702351488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674865:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702351488:12345-0@lo:400:kworker.0 Request processed in 40us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845903.674871:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788845903.674983:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702350592:0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674992:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702351104:0@lo:400:kworker.0 00000100:00100000:1.0:1788845903.674999:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702350464:0@lo:400:kworker.0 00010000:00080000:1.0:1788845903.675010:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad4380 x1875740702350976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845903.675019:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702350976:0@lo:400:kworker.0 00010000:00080000:1.0:1788845903.675027:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad6300 x1875740702351488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845903.675034:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702351488:0@lo:400:kworker.0 00000100:00080000:2.0:1788845903.675728:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845903.675734:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845903.675736:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845903.675854:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702350208:0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.675909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845903.675947:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702350720:0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.675971:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845903.675986:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702351232:0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676007:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845903.676027:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788845903.676033:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702350336:0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676052:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845903.676066:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702350848:0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676097:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845903.676113:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702351360:0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676133:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845903.676163:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702351232 00000100:00100000:3.0:1788845903.676168:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702351232 00000100:00100000:3.0:1788845903.676198:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702350336 00000100:00100000:3.0:1788845903.676201:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702350336 00000100:00100000:3.0:1788845903.676210:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702350848 00000100:00100000:3.0:1788845903.676213:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702350848 00000100:00100000:3.0:1788845903.676225:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788845903.676231:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702351232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676271:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702351232:12345-0@lo:400:kworker.0 Request processed in 40us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845903.676277:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788845903.676290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788845903.676295:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702350336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676320:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702350336:12345-0@lo:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845903.676331:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788845903.676343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788845903.676349:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702350848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676375:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702350848:12345-0@lo:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845903.676381:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788845903.676397:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702351360 00000100:00100000:3.0:1788845903.676400:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702351360 00000100:00100000:3.0:1788845903.676424:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845903.676429:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702351360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676456:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702351360:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845903.676462:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788845903.676499:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702350336:0@lo:400:kworker.0 00000100:00100000:3.0:1788845903.676508:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702350848:0@lo:400:kworker.0 00010000:00080000:3.0:1788845903.676540:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad5880 x1875740702351360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845903.676551:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702351360:0@lo:400:kworker.0 00010000:00080000:3.0:1788845903.676562:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad7480 x1875740702351232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845903.676570:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702351232:0@lo:400:kworker.0 00000100:00100000:2.0:1788845903.678695:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702350208 00000100:00100000:2.0:1788845903.678707:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702350208 00000100:00100000:2.0:1788845903.678769:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788845903.678778:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702350208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845903.678860:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702350208:12345-0@lo:400:kworker.0 Request processed in 84us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845903.678867:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788845903.678900:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702350720 00000100:00100000:2.0:1788845903.678904:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702350720 00000100:00100000:2.0:1788845903.678928:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788845903.678934:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702350720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845903.678968:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702350720:12345-0@lo:400:kworker.0 Request processed in 34us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845903.678974:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788845903.678989:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845903.678993:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845903.678996:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788845903.679023:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702350208:0@lo:400:kworker.0 00000100:00100000:2.0:1788845903.679036:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702350720:0@lo:400:kworker.0 00000100:00100000:0.0:1788845903.680611:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845903.680628:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702351616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845903.680678:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845903.680951:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702351616 00000100:00100000:2.0:1788845903.680958:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702351616 00000100:00100000:2.0:1788845903.680994:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788845903.681002:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702351616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788845903.681030:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788845903.681097:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702351616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845903.681104:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788845903.681269:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702351616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845904.185805:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845904.185837:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702351744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845904.185918:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845904.186218:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702351744 00000100:00100000:1.0:1788845904.186226:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702351744 00000100:00100000:1.0:1788845904.186281:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788845904.186302:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702351744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845904.186329:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845904.186382:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702351744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845904.186388:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788845904.186551:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c13800 x1875740702351744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845904.186570:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702351744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845904.192500:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845904.197182:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702351872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845904.197256:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845904.197625:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702351872 00000100:00100000:1.0:1788845904.197645:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702351872 00000100:00100000:1.0:1788845904.197700:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788845904.197709:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702351872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788845904.197731:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845904.198523:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702351872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 812us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845904.198549:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788845904.198805:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3eb480 x1875740702351872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845904.198833:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702351872:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788845904.697738:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845905.723690:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845905.723904:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845905.726684:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702352000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788845905.726759:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:02000400:1.0:1788845905.729037:0:11212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.105 00000100:00100000:2.0:1788845905.729282:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702352000 00000100:00100000:2.0:1788845905.729291:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702352000 00000100:00100000:2.0:1788845905.729387:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788845905.729397:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702352000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788845905.729665:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845905.729736:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702352000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 340us (2978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845905.729743:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845905.729815:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702352000:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788845906.757836:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845906.801453:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845906.801491:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845906.801511:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683412736 00000100:00100000:2.0:1788845906.801536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683412736 00000100:00100000:0.0:1788845906.801548:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845906.801572:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683412480 00000100:00100000:0.0:1788845906.801576:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683412480 00000100:00100000:0.0:1788845906.801623:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 281 00000100:00100000:0.0:1788845906.801633:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683412480:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845906.801892:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683412608 00000100:00100000:1.0:1788845906.801898:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683412608 00000100:00100000:1.0:1788845906.801941:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:1.0:1788845906.801949:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683412608:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845906.801996:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:2.0:1788845906.802003:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683412736:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845906.802084:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683412480:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 449us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845906.802091:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 281 00000100:00080000:0.0:1788845906.802817:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845906.802831:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845906.803340:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683412736:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 1333us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845906.803350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:1.0:1788845906.803915:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683412608:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 1964us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845906.803923:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 85 00010000:00010000:0.0:1788845907.771240:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788845907.777183:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:3.0:1788845907.777193:0:8426:0:(genops.c:885:class_export_put()) final put ffff90e4437d1000/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:0.0:1788845907.777369:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4437d1000/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 for lustre-OST0000 00000020:00000080:0.0:1788845907.777432:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47f428000 for lustre-OST0000 00000001:00100000:2.0:1788845907.778191:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:2.0:1788845907.778197:0:9508:0:(genops.c:885:class_export_put()) final put ffff90e47f428800/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:1.0:1788845907.778422:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47f428800/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 for lustre-OST0001 00000020:00000080:1.0:1788845907.778458:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47f42d800 for lustre-OST0001 00000100:00100000:2.0:1788845908.281980:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845908.282013:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702352128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845908.282090:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845908.282777:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702352128 00000100:00100000:0.0:1788845908.282787:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702352128 00000100:00100000:0.0:1788845908.282856:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788845908.282867:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702352128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845908.282894:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845908.282946:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702352128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845908.282953:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788845908.283026:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845908.283231:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e9c00 x1875740702352128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845908.283251:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702352128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845908.283547:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845908.283630:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702352256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845908.283672:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845908.283793:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702352256 00000100:00100000:2.0:1788845908.283798:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702352256 00000100:00100000:2.0:1788845908.283853:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845908.283857:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788845908.283860:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702352256:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845908.283865:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788845908.283872:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845908.283909:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702352256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845908.283915:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788845908.283971:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845908.284026:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c10e00 x1875740702352256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845908.284040:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702352256:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788845908.794246:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845908.799436:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845908.799467:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702352384:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.799578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845908.799755:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702352512:0@lo:400:kworker.0 00000100:00100000:2.0:1788845908.799816:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845908.799872:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702352384 00000100:00100000:2.0:1788845908.799881:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702352384 00000100:00100000:2.0:1788845908.799931:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788845908.799941:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702352384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845908.799992:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702352384:12345-0@lo:400:kworker.0 Request processed in 53us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845908.800000:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788845908.800051:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702352384:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.800378:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702352512 00000100:00100000:1.0:1788845908.800383:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702352512 00000100:00100000:1.0:1788845908.800420:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788845908.800428:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702352512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.800468:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702352512:12345-0@lo:400:kworker.0 Request processed in 41us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845908.800475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788845908.800968:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702352512:0@lo:400:kworker.0 00000100:00100000:0.0:1788845908.803136:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788845908.803155:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702352640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845908.803232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845908.803713:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702352640 00000100:00100000:2.0:1788845908.803722:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702352640 00000100:00100000:2.0:1788845908.813178:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788845908.813205:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702352640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788845908.813382:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788845908.813480:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702352640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 288us (10247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845908.813487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788845908.813637:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702352640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845908.827046:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845908.827076:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702352768:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.827147:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845908.827656:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702353280:0@lo:400:kworker.0 00000100:00100000:0.0:1788845908.827691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845908.827720:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702353792:0@lo:400:kworker.0 00000100:00100000:0.0:1788845908.827744:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845908.827761:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788845908.827767:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702352896:0@lo:400:kworker.0 00000100:00100000:0.0:1788845908.827802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845908.827828:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702353408:0@lo:400:kworker.0 00000100:00100000:0.0:1788845908.827851:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845908.827978:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702353792 00000100:00100000:1.0:1788845908.827986:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702353792 00000100:00100000:1.0:1788845908.828049:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788845908.828059:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702353792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828112:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702353792:12345-0@lo:400:kworker.0 Request processed in 55us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845908.828120:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788845908.828142:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702353280 00000100:00100000:1.0:1788845908.828146:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702353280 00000100:00100000:1.0:1788845908.828182:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702352896 00000100:00100000:1.0:1788845908.828186:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702352896 00000100:00100000:1.0:1788845908.828198:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702353408 00000100:00100000:1.0:1788845908.828200:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702353408 00000100:00100000:1.0:1788845908.828213:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788845908.828219:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702353280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828267:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702353280:12345-0@lo:400:kworker.0 Request processed in 48us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845908.828274:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788845908.828292:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788845908.828298:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702352896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845908.828309:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702352768 00000100:00100000:3.0:1788845908.828313:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702352768 00000100:00100000:1.0:1788845908.828324:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702352896:12345-0@lo:400:kworker.0 Request processed in 27us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845908.828330:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788845908.828340:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788845908.828341:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788845908.828346:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702353408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845908.828347:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702352768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828372:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702353408:12345-0@lo:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845908.828374:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702352768:12345-0@lo:400:kworker.0 Request processed in 29us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845908.828378:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788845908.828379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788845908.828401:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702353152:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845908.828452:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702353664:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828472:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845908.828490:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788845908.828494:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702353024:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828515:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845908.828561:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702353536:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845908.828607:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702353024 00000100:00100000:1.0:1788845908.828611:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702353024 00000100:00100000:1.0:1788845908.828631:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788845908.828644:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702353024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828680:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702353024:12345-0@lo:400:kworker.0 Request processed in 37us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845908.828686:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788845908.828701:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702353152 00000100:00100000:1.0:1788845908.828704:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702353152 00000100:00100000:1.0:1788845908.828719:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702353536 00000100:00100000:1.0:1788845908.828722:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702353536 00000100:00100000:1.0:1788845908.828733:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788845908.828738:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702353152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702353152:12345-0@lo:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845908.828769:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788845908.828923:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788845908.828931:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702353536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.828959:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702353536:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845908.828965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788845908.829005:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702352768:0@lo:400:kworker.0 00000100:00100000:3.0:1788845908.829006:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702353664 00000100:00100000:3.0:1788845908.829009:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702353664 00000100:00100000:1.0:1788845908.829034:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702353024:0@lo:400:kworker.0 00000100:00100000:3.0:1788845908.829035:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788845908.829041:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702353664:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788845908.829046:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4000 x1875740702353536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845908.829055:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702353536:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.829065:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702353152:0@lo:400:kworker.0 00000100:00100000:3.0:1788845908.829086:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702353664:12345-0@lo:400:kworker.0 Request processed in 46us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845908.829091:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788845908.829094:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343935c00 x1875740702353664/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845908.829102:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702353664:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.829127:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702352896:0@lo:400:kworker.0 00000100:00100000:1.0:1788845908.829137:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702353408:0@lo:400:kworker.0 00010000:00080000:1.0:1788845908.829147:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f5180 x1875740702353280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788845908.829234:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845908.829239:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845908.829241:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845908.829290:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702353280:0@lo:400:kworker.0 00010000:00080000:1.0:1788845908.829305:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343937100 x1875740702353792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845908.829314:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702353792:0@lo:400:kworker.0 00000100:00100000:2.0:1788845909.305816:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702353920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845909.305888:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845909.305960:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702353920 00000100:00100000:2.0:1788845909.305969:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702353920 00000100:00100000:2.0:1788845909.306015:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788845909.306024:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702353920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788845909.306052:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845909.306092:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702353920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845909.306099:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788845909.306138:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343936300 x1875740702353920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845909.306156:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702353920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845909.308588:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788845909.308610:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702354048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845909.308668:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845909.308715:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702354048 00000100:00100000:2.0:1788845909.308742:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702354048 00000100:00100000:2.0:1788845909.308790:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788845909.308798:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702354048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845909.308827:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845909.308867:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702354048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845909.308874:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788845909.308907:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343936300 x1875740702354048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845909.308922:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702354048:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788845909.526063:0:11311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.105 00010000:00010000:0.0:1788845909.820053:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845910.841768:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845910.852754:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845910.860357:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702354176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788845910.860461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845910.860670:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702354176 00000100:00100000:3.0:1788845910.860678:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702354176 00000100:00100000:3.0:1788845910.860728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788845910.860738:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702354176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788845910.860773:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788845910.860835:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702354176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845910.860853:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788845910.861135:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702354176:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788845911.750447:0:11359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 01:38:29 EDT 2026 00010000:00010000:2.0:1788845911.868732:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845911.928902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845911.928948:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845911.928979:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683412864 00000100:00100000:3.0:1788845911.928989:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683412864 00000100:00100000:3.0:1788845911.929041:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 283 00000100:00100000:3.0:1788845911.929051:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683412864:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845911.929120:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683412864:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 70us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845911.929129:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 283 00000100:00100000:3.0:1788845911.929160:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683413120 00000100:00100000:3.0:1788845911.929165:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683413120 00000100:00100000:3.0:1788845911.929203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:3.0:1788845911.929210:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683413120:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845911.929264:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683413120:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845911.929271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00080000:3.0:1788845911.929389:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845911.930092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845911.930115:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683412992 00000100:00100000:3.0:1788845911.930121:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683412992 00000100:00100000:3.0:1788845911.930162:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:3.0:1788845911.930170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683412992:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845911.930214:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683412992:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 46us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845911.930249:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00080000:3.0:1788845911.930271:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788845912.889666:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845913.410345:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702354304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845913.410408:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845913.412082:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702354304 00000100:00100000:1.0:1788845913.412094:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702354304 00000100:00100000:1.0:1788845913.412153:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788845913.412163:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702354304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845913.412292:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845913.412361:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702354304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 200us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845913.412379:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788845913.433100:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845913.433165:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f7100 x1875740702354304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845913.433205:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702354304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845913.433230:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845913.433242:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702354432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845913.433302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845913.433562:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702354432 00000100:00100000:2.0:1788845913.433570:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702354432 00000100:00100000:2.0:1788845913.433624:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788845913.433633:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702354432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845913.433654:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845913.433697:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702354432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845913.433704:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788845913.434059:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845913.434088:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343936300 x1875740702354432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845913.434103:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702354432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845913.914604:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702354560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845913.914672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845913.916259:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845913.916781:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702354560 00000100:00100000:1.0:1788845913.916791:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702354560 00000100:00100000:1.0:1788845913.917185:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788845913.917196:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702354560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788845913.917233:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845913.917313:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702354560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (2641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845913.917321:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788845913.917334:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702354560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845913.921040:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702354816:0@lo:400:kworker.0 00000100:00100000:0.0:1788845913.921105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845913.921145:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702355328:0@lo:400:kworker.0 00000100:00100000:0.0:1788845913.921169:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845913.921172:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702354688:0@lo:400:kworker.0 00000100:00100000:0.0:1788845913.921186:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702355840:0@lo:400:kworker.0 00000100:00100000:2.0:1788845913.921259:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702355072:0@lo:400:kworker.0 00000100:00100000:1.0:1788845913.924411:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702354816 00000100:00100000:1.0:1788845913.924426:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702354816 00000100:00100000:1.0:1788845913.924474:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702355328 00000100:00100000:1.0:1788845913.924478:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702355328 00000100:00100000:1.0:1788845913.924513:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788845913.924548:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702354816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.927980:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845913.928062:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702355200:0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.928123:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845913.928138:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702355712:0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.928163:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845913.928214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702355200 00000100:00100000:3.0:1788845913.928223:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702355200 00000100:00100000:3.0:1788845913.928266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788845913.928277:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702355328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.928327:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702355328:12345-0@lo:400:kworker.0 Request processed in 52us (7156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845913.928334:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788845913.928349:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788845913.928356:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702355200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.928388:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702355200:12345-0@lo:400:kworker.0 Request processed in 33us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845913.928394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788845913.928433:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702354688 00000100:00100000:3.0:1788845913.928437:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702354688 00000100:00100000:3.0:1788845913.928462:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788845913.928469:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702354688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.928498:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702354688:12345-0@lo:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845913.928534:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788845913.928564:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702355712 00000100:00100000:3.0:1788845913.928568:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702355712 00000100:00100000:3.0:1788845913.928597:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845913.928604:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702355712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.928636:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702355712:12345-0@lo:400:kworker.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845913.928642:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788845913.928673:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702354688:0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.928687:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702355200:0@lo:400:kworker.0 00010000:00080000:3.0:1788845913.928699:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e27100 x1875740702355712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845913.928710:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702355712:0@lo:400:kworker.0 00000100:00100000:0.0:1788845913.935949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845913.937341:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702355840 00000100:00100000:3.0:1788845913.937352:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702355840 00000100:00100000:3.0:1788845913.937404:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788845913.937415:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702355840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.937494:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702355840:12345-0@lo:400:kworker.0 Request processed in 81us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845913.937500:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788845913.939300:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24700 x1875740702355840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845913.939318:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702355840:0@lo:400:kworker.0 00010000:00080000:0.0:1788845913.939349:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e27800 x1875740702355328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845913.939357:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702355328:0@lo:400:kworker.0 00000100:00100000:0.0:1788845913.939364:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788845913.939373:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702354944:0@lo:400:kworker.0 00000100:00100000:2.0:1788845913.939376:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845913.939404:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702355584:0@lo:400:kworker.0 00000100:00100000:0.0:1788845913.939407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845913.939425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845913.939426:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702355456:0@lo:400:kworker.0 00000100:00100000:0.0:1788845913.939456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845913.940229:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702354816:12345-0@lo:400:kworker.0 Request processed in 15681us (19122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845913.940240:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788845913.940261:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702354944 00000100:00100000:1.0:1788845913.940267:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702354944 00000100:00100000:1.0:1788845913.940290:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702355584 00000100:00100000:1.0:1788845913.940292:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702355584 00000100:00100000:0.0:1788845913.940294:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702354816:0@lo:400:kworker.0 00000100:00100000:1.0:1788845913.940306:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702355456 00000100:00100000:1.0:1788845913.940308:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702355456 00000100:00100000:1.0:1788845913.940322:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788845913.940329:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702354944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845913.940381:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702354944:12345-0@lo:400:kworker.0 Request processed in 52us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845913.940387:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788845913.940399:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788845913.940405:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702355584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845913.940440:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702355584:12345-0@lo:400:kworker.0 Request processed in 35us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845913.940446:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788845913.940457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788845913.940463:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702355456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845913.940489:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702355456:12345-0@lo:400:kworker.0 Request processed in 27us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845913.940496:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788845913.940517:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845913.940538:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845913.940540:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788845913.940642:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702354944:0@lo:400:kworker.0 00000100:00100000:0.0:1788845913.940652:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702355456:0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.941875:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702355072 00000100:00100000:3.0:1788845913.941885:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702355072 00000100:00100000:3.0:1788845913.941919:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788845913.941927:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702355072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845913.941991:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702355072:12345-0@lo:400:kworker.0 Request processed in 65us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845913.941999:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845913.943309:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702355072:0@lo:400:kworker.0 00010000:00080000:2.0:1788845913.943340:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e25500 x1875740702355584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845913.943351:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702355584:0@lo:400:kworker.0 00000100:00100000:0.0:1788845914.441545:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845914.441568:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702355968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845914.441634:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845914.441721:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702355968 00000100:00100000:0.0:1788845914.441728:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702355968 00000100:00100000:0.0:1788845914.442020:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845914.442031:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702355968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845914.442059:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845914.442105:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702355968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845914.442112:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788845914.442150:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24e00 x1875740702355968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845914.442168:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702355968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845914.442515:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702356096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845914.442584:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845914.442622:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702356096 00000100:00100000:3.0:1788845914.442627:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702356096 00000100:00100000:3.0:1788845914.442654:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788845914.442661:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702356096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788845914.442672:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845914.442704:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702356096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845914.442710:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788845914.442737:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4000 x1875740702356096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845914.442777:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702356096:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788845914.944407:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845915.968152:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845915.968175:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702356224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788845915.968253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845915.968328:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702356224 00000100:00100000:3.0:1788845915.968336:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702356224 00000100:00100000:3.0:1788845915.968382:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788845915.968391:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702356224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788845915.968421:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788845915.968465:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702356224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845915.968485:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788845915.968545:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702356224:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788845915.970837:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845916.985823:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845917.048090:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845917.048137:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845917.048170:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845917.048201:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683413504 00000100:00100000:3.0:1788845917.048211:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683413504 00000100:00100000:3.0:1788845917.048272:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683413376 00000100:00100000:3.0:1788845917.048275:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683413376 00000100:00100000:3.0:1788845917.048297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:3.0:1788845917.048306:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683413504:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845917.048371:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:3.0:1788845917.048372:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683413504:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 64us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845917.048382:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:1.0:1788845917.048388:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683413376:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845917.048423:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683413376:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845917.048430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:2.0:1788845917.048488:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683413248 00000100:00100000:2.0:1788845917.048493:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683413248 00000100:00100000:2.0:1788845917.048565:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 285 00000100:00100000:2.0:1788845917.048573:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2401:x1875740683413248:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845917.048601:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2401:x1875740683413248:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845917.048608:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 285 00000100:00080000:3.0:1788845917.048699:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788845917.048703:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788845918.009797:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845918.524486:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702356352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845918.524572:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845918.524644:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702356352 00000100:00100000:1.0:1788845918.524651:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702356352 00000100:00100000:1.0:1788845918.524700:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788845918.524710:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702356352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845918.524738:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845918.524795:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702356352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845918.524802:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788845918.524822:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845918.524851:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4000 x1875740702356352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845918.524869:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702356352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845918.529443:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702356480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845918.529538:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845918.529846:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702356480 00000100:00100000:3.0:1788845918.529856:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702356480 00000100:00100000:3.0:1788845918.529929:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788845918.529939:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702356480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788845918.529974:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845918.530031:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702356480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845918.530038:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788845918.530294:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845918.530325:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24e00 x1875740702356480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845918.530344:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702356480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788845919.033805:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702356736:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.033872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.033922:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702357248:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.033943:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.033975:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702357760:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.033996:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.034022:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788845919.034028:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702356608:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.034055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.034077:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702357120:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.034102:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.034119:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702357632:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.034140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.034157:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702358144:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.034175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.034199:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702356864:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.034436:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.034464:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702357376:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.034486:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.034504:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702357888:0@lo:400:kworker.0 00000100:00100000:3.0:1788845919.034635:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702357120 00000100:00100000:3.0:1788845919.034643:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702357120 00000100:00100000:3.0:1788845919.034694:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702356864 00000100:00100000:3.0:1788845919.034698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702356864 00000100:00100000:3.0:1788845919.034715:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788845919.034724:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702357120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845919.034790:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702357120:12345-0@lo:400:kworker.0 Request processed in 67us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845919.034797:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788845919.034814:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788845919.034821:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702356864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845919.034850:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702356864:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845919.034856:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788845919.034912:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.034948:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702356864:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.034964:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788845919.034971:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702356992:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.034995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.035005:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702357504:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.035024:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.035048:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702358016:0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.035076:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.035109:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702356736 00000100:00100000:0.0:1788845919.035114:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702356736 00000100:00100000:0.0:1788845919.035137:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702357248 00000100:00100000:0.0:1788845919.035140:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702357248 00000100:00100000:0.0:1788845919.035163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702357760 00000100:00100000:0.0:1788845919.035166:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702357760 00000100:00100000:0.0:1788845919.035178:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702357376 00000100:00100000:0.0:1788845919.035181:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702357376 00000100:00100000:0.0:1788845919.035192:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702357888 00000100:00100000:0.0:1788845919.035193:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702357888 00000100:00100000:0.0:1788845919.035203:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702356992 00000100:00100000:0.0:1788845919.035206:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702356992 00000100:00100000:3.0:1788845919.035302:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702357632 00000100:00100000:3.0:1788845919.035306:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702357632 00000100:00100000:3.0:1788845919.035326:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702358144 00000100:00100000:3.0:1788845919.035328:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702358144 00000100:00100000:3.0:1788845919.035339:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702357504 00000100:00100000:3.0:1788845919.035342:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702357504 00000100:00100000:3.0:1788845919.035350:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702358016 00000100:00100000:3.0:1788845919.035353:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702358016 00000100:00100000:3.0:1788845919.035367:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788845919.035373:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702357632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845919.035412:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702357632:12345-0@lo:400:kworker.0 Request processed in 39us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845919.035418:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788845919.035430:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845919.035437:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702358144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845919.035465:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702358144:12345-0@lo:400:kworker.0 Request processed in 30us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845919.035477:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845919.035488:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845919.035493:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702357504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845919.035573:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702357504:12345-0@lo:400:kworker.0 Request processed in 79us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845919.035580:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845919.035592:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845919.035599:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702358016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845919.035624:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702358016:12345-0@lo:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845919.035629:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788845919.035766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788845919.035774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702356736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.035809:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702356736:12345-0@lo:400:kworker.0 Request processed in 36us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.035815:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788845919.035829:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788845919.035835:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702357248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.035862:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702357248:12345-0@lo:400:kworker.0 Request processed in 27us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.035867:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788845919.035878:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788845919.035884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702357760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.035910:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702357760:12345-0@lo:400:kworker.0 Request processed in 26us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.035916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788845919.035936:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788845919.035942:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702357376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.035971:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702357376:12345-0@lo:400:kworker.0 Request processed in 29us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.035976:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788845919.035987:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788845919.035993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702357888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.036019:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702357888:12345-0@lo:400:kworker.0 Request processed in 26us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.036025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788845919.036036:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788845919.036042:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702356992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.036066:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702356992:12345-0@lo:400:kworker.0 Request processed in 25us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.036071:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788845919.036099:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702356608 00000100:00100000:0.0:1788845919.036103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702356608 00000100:00100000:0.0:1788845919.036141:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788845919.036149:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702356608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845919.036178:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702356608:12345-0@lo:400:kworker.0 Request processed in 30us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.036184:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00010000:00010000:1.0:1788845919.036408:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845919.036416:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845919.036430:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702358272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845919.036463:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845919.036563:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702356608:0@lo:400:kworker.0 00000100:00100000:1.0:1788845919.036577:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702357120:0@lo:400:kworker.0 00010000:00080000:1.0:1788845919.036591:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3ad180 x1875740702357632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845919.036601:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702357632:0@lo:400:kworker.0 00010000:00080000:1.0:1788845919.036613:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f476680 x1875740702358144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845919.036621:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702358144:0@lo:400:kworker.0 00000100:00100000:1.0:1788845919.036632:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702356736:0@lo:400:kworker.0 00000100:00100000:1.0:1788845919.036642:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702357248:0@lo:400:kworker.0 00000100:00100000:1.0:1788845919.036653:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702357760:0@lo:400:kworker.0 00000100:00080000:1.0:1788845919.036694:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845919.036700:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788845919.036702:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845919.036730:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702356992:0@lo:400:kworker.0 00010000:00080000:1.0:1788845919.036750:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e25180 x1875740702357504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845919.036759:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702357504:0@lo:400:kworker.0 00010000:00080000:1.0:1788845919.036781:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f474700 x1875740702358016/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845919.036789:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702358016:0@lo:400:kworker.0 00010000:00080000:1.0:1788845919.036800:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e27100 x1875740702357376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845919.036808:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702357376:0@lo:400:kworker.0 00010000:00080000:1.0:1788845919.036818:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3ace00 x1875740702357888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845919.036825:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702357888:0@lo:400:kworker.0 00000100:00100000:3.0:1788845919.037035:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702358272 00000100:00100000:3.0:1788845919.037040:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702358272 00000100:00100000:3.0:1788845919.037076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788845919.037084:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702358272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788845919.037110:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788845919.037153:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702358272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845919.037159:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788845919.037190:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702358272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845919.546601:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845919.546623:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702358400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845919.546690:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.551658:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702358400 00000100:00100000:0.0:1788845919.551673:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702358400 00000100:00100000:0.0:1788845919.551744:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788845919.551755:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702358400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845919.551796:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845919.554831:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702358528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845919.554907:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845919.555409:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702358400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3654us (8717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.555421:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788845919.555448:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702358528 00000100:00100000:0.0:1788845919.555454:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702358528 00000100:00100000:0.0:1788845919.555491:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788845919.555499:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702358528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788845919.555533:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845919.555576:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702358528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845919.555582:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788845919.556673:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343935500 x1875740702358400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845919.556786:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702358400:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788845919.556903:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad7800 x1875740702358528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845919.556916:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702358528:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788845920.057915:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845921.082946:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845921.082970:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702358656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788845921.083033:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845921.083086:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845921.083098:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702358656 00000100:00100000:1.0:1788845921.083104:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702358656 00000100:00100000:1.0:1788845921.083147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788845921.083156:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702358656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788845921.083217:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788845921.083260:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702358656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845921.083268:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788845921.083311:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702358656:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788845922.108545:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845922.163315:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845922.163345:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683413632 00000100:00100000:0.0:1788845922.163355:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683413632 00000100:00100000:0.0:1788845922.163415:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 287 00000100:00100000:0.0:1788845922.163425:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2398:x1875740683413632:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845922.165486:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2398:x1875740683413632:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2052us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845922.165500:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 287 00000100:00100000:2.0:1788845922.167210:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845922.167304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683413760 00000100:00100000:2.0:1788845922.167310:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845922.167315:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683413760 00000100:00100000:1.0:1788845922.167391:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683413888 00000100:00100000:1.0:1788845922.167395:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683413888 00000100:00100000:2.0:1788845922.167414:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:2.0:1788845922.167487:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683413760:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845922.167575:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683413760:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 151us (373us total) trans 0 rc 0/0 00000100:00080000:0.0:1788845922.168830:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845922.168836:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845922.169898:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:1.0:1788845922.169928:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:1.0:1788845922.169944:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683413888:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845922.170033:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683413888:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 96us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845922.170047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 110 00010000:00010000:2.0:1788845923.131655:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845923.642023:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845923.642053:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702358784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845923.642183:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845923.642323:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702358784 00000100:00100000:1.0:1788845923.642334:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702358784 00000100:00100000:1.0:1788845923.642418:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788845923.642429:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702358784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845923.642463:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845923.642541:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702358784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845923.642549:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788845923.642780:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845923.642823:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad7480 x1875740702358784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845923.642846:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702358784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845923.643269:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702358912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845923.643309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845923.643391:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702358912 00000100:00100000:3.0:1788845923.643397:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702358912 00000100:00100000:3.0:1788845923.643456:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788845923.643464:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702358912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788845923.643480:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788845923.643599:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845923.643913:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702358912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 449us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845923.643921:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788845923.644437:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f476300 x1875740702358912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845923.644457:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702358912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845924.153790:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845924.153824:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702359040:0@lo:400:kworker.0 00000100:00100000:0.0:1788845924.153895:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702359552:0@lo:400:kworker.0 00000100:00100000:3.0:1788845924.153929:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845924.154079:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845924.154552:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845924.154729:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702360064:0@lo:400:kworker.0 00000100:00100000:0.0:1788845924.154790:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.154837:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702359552 00000100:00100000:0.0:1788845924.154840:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702360576:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.154848:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702359552 00000100:00100000:0.0:1788845924.154876:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845924.154910:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788845924.154917:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788845924.154921:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702359424:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.154932:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702359552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845924.154955:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845924.154976:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702359936:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155005:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702359552:12345-0@lo:400:kworker.0 Request processed in 76us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845924.155014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155026:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788845924.155046:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702360448:0@lo:400:kworker.0 00000100:00100000:0.0:1788845924.155073:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155122:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702360064 00000100:00100000:1.0:1788845924.155127:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702360064 00000100:00100000:1.0:1788845924.155165:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702360576 00000100:00100000:1.0:1788845924.155169:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702360576 00000100:00100000:1.0:1788845924.155200:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702359936 00000100:00100000:1.0:1788845924.155203:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702359936 00000100:00100000:1.0:1788845924.155218:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702360448 00000100:00100000:1.0:1788845924.155221:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702360448 00000100:00100000:1.0:1788845924.155243:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788845924.155251:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702360064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155291:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702360064:12345-0@lo:400:kworker.0 Request processed in 42us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.155299:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788845924.155312:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788845924.155318:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702360576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155346:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702360576:12345-0@lo:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.155352:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788845924.155363:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788845924.155369:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702359936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845924.155400:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702359552:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155401:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702359936:12345-0@lo:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.155414:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788845924.155429:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788845924.155436:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702360448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155477:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702360448:12345-0@lo:400:kworker.0 Request processed in 42us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.155483:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788845924.155513:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845924.155573:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702359296:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155651:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702359808:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155718:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702360320:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155742:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155764:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788845924.155771:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702359168:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155810:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702359680:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155847:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702360192:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.155866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155876:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702360704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845924.155891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845924.155919:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702359424 00000100:00100000:1.0:1788845924.155923:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702359424 00000100:00100000:1.0:1788845924.155946:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702359808 00000100:00100000:1.0:1788845924.155949:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702359808 00000100:00100000:1.0:1788845924.155967:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702360320 00000100:00100000:1.0:1788845924.155969:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702360320 00000100:00100000:1.0:1788845924.155980:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702359168 00000100:00100000:1.0:1788845924.155989:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702359168 00000100:00100000:1.0:1788845924.156003:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702359680 00000100:00100000:1.0:1788845924.156006:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702359680 00000100:00100000:1.0:1788845924.156018:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702360192 00000100:00100000:1.0:1788845924.156021:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702360192 00000100:00100000:1.0:1788845924.156035:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788845924.156042:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702359424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.156079:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702359424:12345-0@lo:400:kworker.0 Request processed in 38us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.156086:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788845924.156100:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788845924.156107:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702359808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.156143:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702359808:12345-0@lo:400:kworker.0 Request processed in 35us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.156149:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788845924.156161:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788845924.156166:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702360320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.156192:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702360320:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.156197:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788845924.156208:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788845924.156213:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702359168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.156236:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702359168:12345-0@lo:400:kworker.0 Request processed in 22us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.156242:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788845924.156252:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788845924.156258:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702359680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.156294:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702359680:12345-0@lo:400:kworker.0 Request processed in 36us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.156300:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788845924.156312:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788845924.156318:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702360192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.156347:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702360192:12345-0@lo:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.156354:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788845924.156360:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702359296 00000100:00100000:2.0:1788845924.156367:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702359296 00000100:00080000:1.0:1788845924.156378:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845924.156383:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788845924.156405:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702360704 00000100:00100000:2.0:1788845924.156409:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702360704 00000100:00100000:3.0:1788845924.156670:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702359040 00000100:00100000:3.0:1788845924.156675:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702359040 00000100:00100000:3.0:1788845924.156985:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788845924.156995:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702359040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845924.157047:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702359040:12345-0@lo:400:kworker.0 Request processed in 54us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845924.157053:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788845924.159583:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788845924.159617:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875740702359296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.160454:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875740702359296:12345-0@lo:400:kworker.0 Request processed in 849us (4839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.160466:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788845924.160558:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788845924.160570:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702360704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788845924.160608:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845924.160659:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702360704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (4766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845924.160666:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788845924.160881:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e26300 x1875740702360064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845924.160899:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702359168:0@lo:400:kworker.0 00000100:00100000:0.0:1788845924.160907:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702360064:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.160922:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f476680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702359680:0@lo:400:kworker.0 00010000:00080000:0.0:1788845924.160938:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e25880 x1875740702360576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845924.160943:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702360192:0@lo:400:kworker.0 00000100:00100000:0.0:1788845924.160956:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702360576:0@lo:400:kworker.0 00000100:00100000:1.0:1788845924.160991:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702360704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845924.161005:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702359296:0@lo:400:kworker.0 00000100:00100000:0.0:1788845924.161022:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702359424:0@lo:400:kworker.0 00010000:00080000:1.0:1788845924.161027:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e27100 x1875740702359808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845924.161039:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702359808:0@lo:400:kworker.0 00010000:00080000:0.0:1788845924.161044:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e25180 x1875740702359936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845924.161055:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702359936:0@lo:400:kworker.0 00010000:00080000:1.0:1788845924.161059:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e25c00 x1875740702360320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845924.161068:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702360320:0@lo:400:kworker.0 00010000:00080000:0.0:1788845924.161075:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24e00 x1875740702360448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845924.161085:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702360448:0@lo:400:kworker.0 00000100:00100000:3.0:1788845924.163359:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702359040:0@lo:400:kworker.0 00000100:00100000:3.0:1788845924.665809:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702360832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845924.665884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845924.665970:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702360832 00000100:00100000:2.0:1788845924.665983:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702360832 00000100:00100000:3.0:1788845924.666043:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702360960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845924.666063:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788845924.666092:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845924.666092:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702360832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845924.666162:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702360960 00000100:00100000:0.0:1788845924.666167:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702360960 00000100:00100000:0.0:1788845924.666191:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788845924.666209:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702360960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788845924.666234:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788845924.666414:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845924.666471:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702360832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 395us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845924.666478:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788845924.666575:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343935500 x1875740702360832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845924.666596:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702360832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845924.669437:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702360960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3227us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845924.669453:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788845924.669801:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad5c00 x1875740702360960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845924.669828:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702360960:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788845925.193764:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845926.203753:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845926.203786:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702361088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788845926.203882:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845926.203962:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702361088 00000100:00100000:1.0:1788845926.203972:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702361088 00000100:00100000:1.0:1788845926.204030:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788845926.204040:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702361088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788845926.204084:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788845926.204136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702361088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845926.204145:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788845926.204217:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702361088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788845926.204804:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845927.227200:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845927.293660:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845927.293729:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845927.293800:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845927.294146:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683414016 00000100:00100000:0.0:1788845927.294161:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683414016 00000100:00100000:3.0:1788845927.294280:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683414272 00000100:00100000:3.0:1788845927.294286:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683414272 00000100:00100000:3.0:1788845927.294374:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683414144 00000100:00100000:3.0:1788845927.294377:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683414144 00000100:00100000:3.0:1788845927.294409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:3.0:1788845927.294422:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683414272:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845927.294555:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:3.0:1788845927.294562:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683414272:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 141us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845927.294574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:1.0:1788845927.294574:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683414144:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845927.294697:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683414144:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 129us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845927.294705:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:0.0:1788845927.294876:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 289 00000100:00100000:0.0:1788845927.294885:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683414016:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:2.0:1788845927.294890:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845927.294895:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788845927.294916:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2400:x1875740683414016:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845927.294924:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 289 00010000:00010000:1.0:1788845928.249732:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845928.761782:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845928.764869:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702361344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845928.764946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845928.765073:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702361216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845928.765101:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845928.769004:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702361344 00000100:00100000:1.0:1788845928.769018:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702361344 00000100:00100000:1.0:1788845928.769085:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702361216 00000100:00100000:1.0:1788845928.769090:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702361216 00000100:00100000:1.0:1788845928.769109:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845928.769117:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702361344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845928.769148:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845928.769211:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702361344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (4266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845928.769218:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788845928.769236:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788845928.769243:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702361216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845928.769253:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845928.769278:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702361216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (4176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845928.769284:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788845928.769488:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845928.769542:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f454e00 x1875740702361344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845928.769562:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f454e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702361344:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788845928.769576:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3af480 x1875740702361216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845928.769588:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702361216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845929.274057:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702361472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845929.274163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845929.274241:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845929.274264:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702361472 00000100:00100000:1.0:1788845929.274286:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702361472 00000100:00100000:1.0:1788845929.274360:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788845929.274384:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702361472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788845929.274427:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845929.274497:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702361472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845929.274506:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788845929.274658:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702361472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788845929.277431:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702361600:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.277513:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702361728:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.277577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845929.277627:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702362240:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.277650:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845929.277682:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702362752:0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.277718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845929.277724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845929.277769:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702362112:0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.277802:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845929.277840:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702362624:0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.277863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845929.277874:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788845929.277881:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702361984:0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.277906:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845929.277925:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702362496:0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.277953:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845929.277969:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702363008:0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.277991:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845929.278038:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702361600 00000100:00100000:1.0:1788845929.278048:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702361600 00000100:00100000:1.0:1788845929.278114:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788845929.278125:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702361600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845929.278193:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702361600:12345-0@lo:400:kworker.0 Request processed in 71us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845929.278202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788845929.278236:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702361600:0@lo:400:kworker.0 00000100:00100000:1.0:1788845929.278246:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702361728 00000100:00100000:1.0:1788845929.278251:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702361728 00000100:00100000:1.0:1788845929.278279:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702362240 00000100:00100000:1.0:1788845929.278283:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702362240 00000100:00080000:3.0:1788845929.278436:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788845929.278448:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702362752 00000100:00100000:1.0:1788845929.278452:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702362752 00000100:00080000:3.0:1788845929.278473:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788845929.278475:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702362112 00000100:00100000:1.0:1788845929.278479:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702362112 00000100:00080000:3.0:1788845929.278497:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845929.278498:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702362624 00000100:00100000:1.0:1788845929.278502:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702362624 00000100:00100000:1.0:1788845929.278548:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788845929.278556:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702361728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845929.278595:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702361728:12345-0@lo:400:kworker.0 Request processed in 40us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845929.278602:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788845929.278623:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788845929.278631:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702362240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845929.278664:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702362240:12345-0@lo:400:kworker.0 Request processed in 35us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845929.278680:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788845929.278691:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788845929.278697:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702362752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845929.278725:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702362752:12345-0@lo:400:kworker.0 Request processed in 29us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845929.278731:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1788845929.278740:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845929.278744:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788845929.278752:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702362112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.279081:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702361728:0@lo:400:kworker.0 00010000:00080000:2.0:1788845929.279100:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f479880 x1875740702362240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845929.279114:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702362240:0@lo:400:kworker.0 00010000:00080000:2.0:1788845929.279126:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f478e00 x1875740702362752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845929.279135:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702362752:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.279164:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788845929.279175:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702361856:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.279215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845929.279236:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702362368:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.279266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845929.279298:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702362880:0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.279319:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702362496 00000100:00100000:3.0:1788845929.279325:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702362496 00000100:00100000:2.0:1788845929.279328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845929.279375:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702361856 00000100:00100000:2.0:1788845929.279380:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702361856 00000100:00100000:3.0:1788845929.279396:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702363008 00000100:00100000:3.0:1788845929.279400:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702363008 00000100:00100000:2.0:1788845929.279411:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788845929.279422:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702362624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.279423:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702362368 00000100:00100000:3.0:1788845929.279427:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702362368 00000100:00100000:3.0:1788845929.279440:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702362880 00000100:00100000:3.0:1788845929.279442:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702362880 00000100:00100000:3.0:1788845929.279458:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788845929.279465:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702362496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.279477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702362624:12345-0@lo:400:kworker.0 Request processed in 57us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845929.279485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788845929.279506:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702362496:12345-0@lo:400:kworker.0 Request processed in 41us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845929.279507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788845929.279515:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788845929.279550:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702361856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.279598:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702361856:12345-0@lo:400:kworker.0 Request processed in 82us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845929.279605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788845929.279637:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702361984 00000100:00100000:2.0:1788845929.279642:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702361984 00000100:00100000:2.0:1788845929.279684:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788845929.279692:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702361984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.279734:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702361984:12345-0@lo:400:kworker.0 Request processed in 42us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845929.279741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788845929.279754:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788845929.279765:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702363008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.279802:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702363008:12345-0@lo:400:kworker.0 Request processed in 42us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845929.279809:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788845929.279820:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788845929.279827:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702362368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.279866:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702362368:12345-0@lo:400:kworker.0 Request processed in 40us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845929.279873:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788845929.279882:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702362112:12345-0@lo:400:kworker.0 Request processed in 1128us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845929.279889:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788845929.279894:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788845929.280025:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702362880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845929.280055:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702362880:12345-0@lo:400:kworker.0 Request processed in 33us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845929.280454:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788845929.280480:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845929.280493:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702361984:0@lo:400:kworker.0 00010000:00080000:2.0:1788845929.280513:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f479180 x1875740702362496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845929.280558:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702362496:0@lo:400:kworker.0 00010000:00080000:2.0:1788845929.280576:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47a680 x1875740702363008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845929.280586:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702363008:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.280600:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702362112:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.280613:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702362624:0@lo:400:kworker.0 00000100:00100000:2.0:1788845929.280662:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702361856:0@lo:400:kworker.0 00010000:00080000:2.0:1788845929.280687:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47a300 x1875740702362368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845929.280696:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702362368:0@lo:400:kworker.0 00010000:00080000:2.0:1788845929.280718:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f478700 x1875740702362880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845929.280726:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702362880:0@lo:400:kworker.0 00000100:00100000:1.0:1788845929.785693:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702363136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845929.785783:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845929.785874:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702363136 00000100:00100000:1.0:1788845929.785883:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702363136 00000100:00100000:1.0:1788845929.785939:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788845929.785948:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702363136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845929.785983:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845929.786027:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702363136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845929.786034:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788845929.786100:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3ad180 x1875740702363136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845929.786119:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702363136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845929.791254:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845929.791287:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702363264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788845929.791376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845929.791442:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702363264 00000100:00100000:1.0:1788845929.791453:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702363264 00000100:00100000:1.0:1788845929.791556:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788845929.791567:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702363264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788845929.791592:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845929.791648:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702363264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845929.791655:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788845929.791716:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3ad180 x1875740702363264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845929.791734:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702363264:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1788845929.875907:0:11989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:38:48 (1788845928) === 00010000:00010000:1.0:1788845930.297895:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845930.445993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845930.451742:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683414400 00000100:00100000:0.0:1788845930.451762:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683414400 00000100:00100000:2.0:1788845930.452028:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 291 00000100:00100000:2.0:1788845930.452039:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:8712:x1875740683414400:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788845930.452056:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845930.452073:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271a2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175443b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845930.452104:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175443b expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845930.452115:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175443b expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845930.452124:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42ca00, rc 0) 00000100:00100000:2.0:1788845930.452196:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8712:x1875740683414400:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 159us (6212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845930.452203:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 291 00000100:00100000:3.0:1788845930.456830:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.456975:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683414528 00000100:00100000:1.0:1788845930.456986:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683414528 00000100:00100000:1.0:1788845930.457065:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 292 00000100:00100000:1.0:1788845930.457076:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8712:x1875740683414528:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788845930.457243:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8712:x1875740683414528:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 168us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.457268:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 292 00000100:00100000:0.0:1788845930.465004:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845930.465233:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683414656 00000100:00100000:2.0:1788845930.465242:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683414656 00000100:00100000:2.0:1788845930.465298:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00100000:2.0:1788845930.465307:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8712:x1875740683414656:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788845930.465461:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8712:x1875740683414656:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 155us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845930.465469:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00100000:2.0:1788845930.481479:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.483366:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683414784 00000100:00100000:1.0:1788845930.483381:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683414784 00000100:00100000:1.0:1788845930.483489:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 294 00000100:00100000:1.0:1788845930.483501:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8716:x1875740683414784:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845930.483698:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8716:x1875740683414784:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 199us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.483706:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 294 00000100:00100000:0.0:1788845930.527958:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845930.528054:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683414912 00000100:00100000:3.0:1788845930.528073:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683414912 00000100:00100000:3.0:1788845930.528180:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 295 00000100:00100000:3.0:1788845930.528194:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8716:x1875740683414912:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845930.528434:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8716:x1875740683414912:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 242us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845930.528442:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 295 00000100:00100000:0.0:1788845930.540152:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.540507:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683415040 00000100:00100000:1.0:1788845930.540517:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683415040 00000100:00100000:1.0:1788845930.540595:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 296 00000100:00100000:1.0:1788845930.540606:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8716:x1875740683415040:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845930.540787:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8716:x1875740683415040:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 182us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.540796:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 296 00000100:00100000:1.0:1788845930.546489:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845930.546607:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683415168 00000100:00100000:2.0:1788845930.546627:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683415168 00000100:00100000:2.0:1788845930.546725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 297 00000100:00100000:2.0:1788845930.546738:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:8712:x1875740683415168:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788845930.546760:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845930.546786:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c400/0x21b4d56138271a35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175446c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845930.546827:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c400/0x21b4d56138271a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175446c expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845930.546841:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c400/0x21b4d56138271a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175446c expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845930.546853:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c400, rc 0) 00000100:00100000:2.0:1788845930.546943:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:8712:x1875740683415168:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 207us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845930.546951:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 297 00000100:00100000:0.0:1788845930.554959:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.555064:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683415296 00000100:00100000:1.0:1788845930.555452:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683415296 00000100:00100000:1.0:1788845930.555587:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 298 00000100:00100000:1.0:1788845930.555611:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:8712:x1875740683415296:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788845930.555647:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788845930.555690:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788845930.555696:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788845930.555699:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788845930.555703:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788845930.555714:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788845930.564334:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:8712:x1875740683415296:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 8710us (9368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.564355:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 298 00000100:00100000:0.0:1788845930.570572:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.576060:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683415424 00000100:00100000:1.0:1788845930.576289:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683415424 00000100:00100000:1.0:1788845930.576473:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 299 00000100:00100000:1.0:1788845930.576487:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:8712:x1875740683415424:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788845930.576513:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845930.576567:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754473 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845930.576617:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845930.576630:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845930.576639:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2c00, rc 0) 00000100:00100000:1.0:1788845930.576739:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8712:x1875740683415424:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 254us (6182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.576747:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 299 00000100:00100000:0.0:1788845930.588758:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.589355:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683415552 00000100:00100000:1.0:1788845930.589369:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683415552 00000100:00100000:1.0:1788845930.589449:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 300 00000100:00100000:1.0:1788845930.589460:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8712:x1875740683415552:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788845930.589789:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8712:x1875740683415552:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 330us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.589819:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 300 00000100:00100000:0.0:1788845930.594368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.594897:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683415680 00000100:00100000:1.0:1788845930.594913:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683415680 00000100:00100000:1.0:1788845930.595044:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00100000:1.0:1788845930.595058:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8712:x1875740683415680:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788845930.595281:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8712:x1875740683415680:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 225us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.595291:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00100000:0.0:1788845930.608577:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845930.608701:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683415808 00000100:00100000:2.0:1788845930.608715:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683415808 00000100:00100000:2.0:1788845930.608782:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 302 00000100:00100000:2.0:1788845930.608792:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8721:x1875740683415808:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845930.609001:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8721:x1875740683415808:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 209us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845930.609010:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 302 00000100:00100000:0.0:1788845930.615394:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.616139:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683415936 00000100:00100000:1.0:1788845930.616156:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683415936 00000100:00100000:1.0:1788845930.616242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 303 00000100:00100000:1.0:1788845930.616254:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8721:x1875740683415936:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788845930.619411:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:8721:x1875740683415936:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 406us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.619436:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 303 00000100:00100000:0.0:1788845930.631126:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845930.631286:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845930.631610:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683416064 00000100:00100000:3.0:1788845930.631624:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683416064 00000100:00100000:3.0:1788845930.631682:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683416320 00000100:00100000:3.0:1788845930.631686:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683416320 00000100:00100000:3.0:1788845930.631718:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788845930.631729:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1875740683416064:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788845930.631767:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from d427c55d-013b-49aa-ae4d-d3c385e9b3d8@192.168.203.20@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1788845930.631832:0:6517:0:(genops.c:1385:class_connect()) connect: client d427c55d-013b-49aa-ae4d-d3c385e9b3d8, cookie 0x21b4d56138271a43 00000004:00100000:3.0:1788845930.631868:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788845930.632019:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90e342a27800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845930.632106:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2397:x1875740683416064:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 376us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845930.632126:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788845930.632146:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1788845930.632151:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1875740683416320:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788845930.632167:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from d427c55d-013b-49aa-ae4d-d3c385e9b3d8@192.168.203.20@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1788845930.632194:0:6517:0:(genops.c:1385:class_connect()) connect: client d427c55d-013b-49aa-ae4d-d3c385e9b3d8, cookie 0x21b4d56138271a4a 00000004:00100000:3.0:1788845930.632207:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788845930.632271:0:6517:0:(import.c:65:import_set_state_nolock()) ffff90e342a25000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845930.632297:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2397:x1875740683416320:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 144us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845930.632304:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:0.0:1788845930.637168:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845930.637222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845930.637312:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683416832 00000100:00100000:2.0:1788845930.637344:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683416832 00000100:00100000:3.0:1788845930.637376:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683416704 00000100:00100000:3.0:1788845930.637383:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683416704 00000100:00100000:2.0:1788845930.637460:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:2.0:1788845930.637474:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683416832:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845930.637627:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683416832:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 156us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845930.637644:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00080000:0.0:1788845930.637862:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845930.637867:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845930.638005:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:3.0:1788845930.638016:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683416704:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845930.638069:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683416704:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 56us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845930.638076:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:0.0:1788845930.650081:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845930.650776:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845930.650949:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683416576 00000100:00100000:2.0:1788845930.650964:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683416576 00000100:00100000:2.0:1788845930.651099:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683416192 00000100:00100000:2.0:1788845930.651104:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683416192 00000100:00080000:0.0:1788845930.651197:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845930.659055:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788845930.659095:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+7:8712:x1875740683416576:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788845930.659156:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845930.659293:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f457800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+7:8712:x1875740683416576:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 219us (9225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.659302:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788845930.659335:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1788845930.659343:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:0:x1875740683416192:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788845930.659377:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845930.659403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:0:x1875740683416192:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 61us (8631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845930.661136:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1788845930.668976:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845930.669201:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845930.679089:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683416448 00000100:00100000:2.0:1788845930.679112:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683416448 00000100:00100000:2.0:1788845930.679227:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683416960 00000100:00100000:2.0:1788845930.679232:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683416960 00000100:00100000:2.0:1788845930.679268:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1788845930.679281:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:0:x1875740683416448:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788845930.679339:0:7876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:0.0:1788845930.679543:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788845930.680324:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:0:x1875740683416448:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 1038us (11517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845930.680335:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1788845930.680375:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1788845930.680389:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:8712:x1875740683416960:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788845930.680516:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:8712:x1875740683416960:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 131us (11314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845930.680626:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1788845930.692328:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845930.692395:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845930.692454:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845930.692740:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683417088 00000100:00100000:3.0:1788845930.692755:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683417088 00000100:00100000:3.0:1788845930.692824:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683417216 00000100:00100000:3.0:1788845930.692828:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683417216 00000100:00100000:3.0:1788845930.692855:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788845930.692866:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875740683417088:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788845930.692913:0:8906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from d427c55d-013b-49aa-ae4d-d3c385e9b3d8@192.168.203.20@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1788845930.692987:0:8906:0:(genops.c:1385:class_connect()) connect: client d427c55d-013b-49aa-ae4d-d3c385e9b3d8, cookie 0x21b4d56138271a51 00002000:00100000:3.0:1788845930.693003:0:8906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d427c55d-013b-49aa-ae4d-d3c385e9b3d8/ffff90e342a26000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788845930.693046:0:8906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788845930.693156:0:8906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788845930.693192:0:8906:0:(import.c:65:import_set_state_nolock()) ffff90e342a23800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845930.693284:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2397:x1875740683417088:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 417us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845930.693293:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788845930.693317:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1788845930.693323:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875740683417216:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788845930.693346:0:8906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from d427c55d-013b-49aa-ae4d-d3c385e9b3d8@192.168.203.20@tcp t0 exp 0000000000000000 cur 314 last 0 00000020:00000080:3.0:1788845930.693369:0:8906:0:(genops.c:1385:class_connect()) connect: client d427c55d-013b-49aa-ae4d-d3c385e9b3d8, cookie 0x21b4d56138271a58 00002000:00100000:3.0:1788845930.693377:0:8906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d427c55d-013b-49aa-ae4d-d3c385e9b3d8/ffff90e342a20800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788845930.693384:0:8906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788845930.693449:0:8906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788845930.693467:0:8906:0:(import.c:65:import_set_state_nolock()) ffff90e342a22800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788845930.693498:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f454000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2397:x1875740683417216:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 173us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845930.693506:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1788845930.694434:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683417344 00000100:00100000:2.0:1788845930.694449:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683417344 00000100:00100000:2.0:1788845930.694760:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1788845930.694772:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:8712:x1875740683417344:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788845930.694873:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:8712:x1875740683417344:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 102us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845930.694882:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1788845930.705693:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845930.705827:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683417472 00000100:00100000:3.0:1788845930.705840:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683417472 00000100:00100000:3.0:1788845930.705917:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:3.0:1788845930.705930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:8712:x1875740683417472:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788845930.706054:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788845930.706192:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:8712:x1875740683417472:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 265us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845930.706201:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00010000:00010000:1.0:1788845931.322084:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845931.322194:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702363392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788845931.322315:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845931.322636:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702363392 00000100:00100000:1.0:1788845931.322647:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702363392 00000100:00100000:1.0:1788845931.322723:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788845931.322735:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702363392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788845931.322782:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788845931.322847:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702363392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845931.322855:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788845931.323152:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702363392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788845932.346707:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845933.369750:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845933.882851:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702363520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845933.882931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845933.883010:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702363520 00000100:00100000:2.0:1788845933.883018:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702363520 00000100:00100000:2.0:1788845933.883075:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788845933.883085:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702363520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845933.883114:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845933.883160:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702363520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845933.883180:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788845933.883203:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845933.883237:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47a300 x1875740702363520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845933.883256:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702363520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845933.885435:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702363648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845933.885495:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845933.885600:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702363648 00000100:00100000:3.0:1788845933.885618:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702363648 00000100:00100000:3.0:1788845933.885690:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788845933.885700:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702363648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788845933.885721:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845933.889891:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702363648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4183us (4385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845933.889906:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788845933.889946:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845933.890029:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f454380 x1875740702363648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845933.890053:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f454380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702363648:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788845934.393711:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845934.394472:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845934.394493:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702363776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845934.394597:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845934.394967:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702364160:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.395000:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845934.395026:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702364672:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.395051:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845934.395081:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702365184:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.395104:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845934.395122:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788845934.395128:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702364032:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.395149:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845934.395164:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702364544:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.395183:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845934.395328:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702365056:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.395352:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845934.395381:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702364160 00000100:00100000:1.0:1788845934.395388:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702364160 00000100:00100000:1.0:1788845934.395423:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702364032 00000100:00100000:1.0:1788845934.395427:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702364032 00000100:00100000:1.0:1788845934.395439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702364544 00000100:00100000:1.0:1788845934.395441:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702364544 00000100:00100000:1.0:1788845934.395461:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702365056 00000100:00100000:1.0:1788845934.395464:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702365056 00000100:00100000:1.0:1788845934.395480:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788845934.395488:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702364160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845934.395706:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702363776 00000100:00100000:2.0:1788845934.395711:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702363776 00000100:00100000:3.0:1788845934.395788:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702364288:0@lo:400:kworker.0 00000100:00100000:3.0:1788845934.395818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845934.395869:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702363904:0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.395902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845934.395928:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702364416:0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.395951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845934.395962:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702364928:0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.395979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788845934.396017:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788845934.396027:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702364416 00000100:00100000:0.0:1788845934.396031:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702364416 00000100:00100000:0.0:1788845934.396053:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702364928 00000100:00100000:0.0:1788845934.396065:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702364928 00000100:00100000:0.0:1788845934.396086:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788845934.396092:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702364032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.399891:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702364160:12345-0@lo:400:kworker.0 Request processed in 4392us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845934.399906:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788845934.399942:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788845934.399958:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702364544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845934.400116:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702364800:0@lo:400:kworker.0 00000100:00100000:3.0:1788845934.400154:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845934.400177:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702365312:0@lo:400:kworker.0 00000100:00100000:3.0:1788845934.400219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845934.400266:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702364672 00000100:00100000:3.0:1788845934.400273:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702364672 00000100:00100000:3.0:1788845934.400300:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702365184 00000100:00100000:3.0:1788845934.400302:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702365184 00000100:00100000:3.0:1788845934.400314:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702364800 00000100:00100000:3.0:1788845934.400316:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702364800 00000100:00100000:3.0:1788845934.400325:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702365312 00000100:00100000:3.0:1788845934.400327:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702365312 00000100:00100000:3.0:1788845934.400339:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788845934.400362:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702364672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845934.400429:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702364288 00000100:00100000:2.0:1788845934.400433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702364288 00000100:00100000:2.0:1788845934.400456:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788845934.400471:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702363776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788845934.400499:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788845934.400569:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702363776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (5972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845934.400576:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788845934.400591:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788845934.400598:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702364288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845934.400642:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702364288:12345-0@lo:400:kworker.0 Request processed in 35us (4813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845934.400649:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788845934.401381:0:7876:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788845934.401392:0:7876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788845934.401412:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788845934.401422:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788845934.401432:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702365056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.401540:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702364032:12345-0@lo:400:kworker.0 Request processed in 5446us (6388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845934.401556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788845934.401582:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788845934.401590:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702365184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.401623:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702365184:12345-0@lo:400:kworker.0 Request processed in 35us (6518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845934.401630:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788845934.401675:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788845934.401682:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702364800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.401711:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702364800:12345-0@lo:400:kworker.0 Request processed in 30us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845934.401717:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788845934.401729:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788845934.401735:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702365312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.401774:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702365312:12345-0@lo:400:kworker.0 Request processed in 39us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845934.401780:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788845934.401804:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845934.401809:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845934.401816:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788845934.401839:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788845934.401847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702364416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.401888:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702364416:12345-0@lo:400:kworker.0 Request processed in 43us (5936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845934.401895:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788845934.401908:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788845934.401914:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788845934.401920:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702364928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.401950:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f454e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702364928:12345-0@lo:400:kworker.0 Request processed in 29us (5969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845934.401955:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788845934.402012:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702364032:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.402898:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702364544:12345-0@lo:400:kworker.0 Request processed in 2944us (7710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845934.402908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788845934.402976:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702363904 00000100:00100000:1.0:1788845934.402983:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702363904 00000100:00100000:1.0:1788845934.403021:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788845934.403029:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702363904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.403074:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702363904:12345-0@lo:400:kworker.0 Request processed in 46us (7171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845934.403080:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788845934.403126:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702363904:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.403141:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702364416:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.403153:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702364928:0@lo:400:kworker.0 00000100:00100000:1.0:1788845934.403170:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702363776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845934.403442:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702365056:12345-0@lo:400:kworker.0 Request processed in 2010us (8087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845934.403450:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788845934.403651:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702364672:12345-0@lo:400:kworker.0 Request processed in 3289us (8597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845934.403660:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788845934.403714:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702364288:0@lo:400:kworker.0 00010000:00080000:3.0:1788845934.403730:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a7480 x1875740702364800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788845934.404172:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a5f80 x1875740702364544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845934.404185:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702364544:0@lo:400:kworker.0 00000100:00100000:3.0:1788845934.404324:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702364800:0@lo:400:kworker.0 00010000:00080000:0.0:1788845934.404400:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752a9500 x1875740702365056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845934.404411:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702365056:0@lo:400:kworker.0 00000100:00100000:0.0:1788845934.404427:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702364160:0@lo:400:kworker.0 00010000:00080000:0.0:1788845934.404439:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a4000 x1875740702364672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845934.404447:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702364672:0@lo:400:kworker.0 00010000:00080000:0.0:1788845934.404459:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752ab100 x1875740702365184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845934.404466:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702365184:0@lo:400:kworker.0 00010000:00080000:3.0:1788845934.404627:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752a8a80 x1875740702365312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845934.404647:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702365312:0@lo:400:kworker.0 00000100:00100000:3.0:1788845934.907681:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845934.907704:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702365440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845934.907801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845934.907918:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702365440 00000100:00100000:2.0:1788845934.907926:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702365440 00000100:00100000:2.0:1788845934.907979:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788845934.907988:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702365440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788845934.908015:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845934.908060:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702365440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845934.908067:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1788845934.908115:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752a9180 x1875740702365440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845934.908134:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702365440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845934.908576:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702365568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845934.908607:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845934.908862:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702365568 00000100:00100000:0.0:1788845934.908868:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702365568 00000100:00100000:0.0:1788845934.908905:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788845934.908913:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702365568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845934.908925:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845934.908969:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702365568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845934.908975:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788845934.909057:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24e00 x1875740702365568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845934.909071:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702365568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788845935.417685:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788845935.934095:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000001:00100000:3.0:1788845935.934388:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000100:00100000:1.0:1788845935.989584:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845935.989635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845935.989680:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845935.989711:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683417600 00000100:00100000:1.0:1788845935.989712:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845935.989724:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683417600 00000100:00100000:1.0:1788845935.989743:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845935.989764:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845935.989785:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 305 00000100:00100000:3.0:1788845935.989801:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2401:x1875740683417600:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845935.989801:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845935.989832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683417856 00000100:00100000:1.0:1788845935.989837:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683417856 00000100:00100000:1.0:1788845935.989876:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683418112 00000100:00100000:1.0:1788845935.989880:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683418112 00000100:00100000:1.0:1788845935.989897:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683417728 00000100:00100000:1.0:1788845935.989900:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683417728 00000100:00100000:1.0:1788845935.989916:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683417984 00000100:00100000:1.0:1788845935.989919:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683417984 00000100:00100000:1.0:1788845935.989946:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:1.0:1788845935.989954:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683417856:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845935.990039:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683417856:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 84us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.990047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:1.0:1788845935.990203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:1.0:1788845935.990213:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683418112:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845935.990245:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683418112:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.990251:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:1.0:1788845935.990268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:1.0:1788845935.990275:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683417728:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845935.990314:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:2.0:1788845935.990325:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683417984:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845935.990356:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683417984:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845935.990363:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:1.0:1788845935.990378:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683417728:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 103us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.990385:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:1.0:1788845935.990402:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683418368 00000100:00100000:1.0:1788845935.990406:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683418368 00000100:00100000:1.0:1788845935.990439:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683418240 00000100:00100000:1.0:1788845935.990443:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683418240 00000100:00100000:2.0:1788845935.990463:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:1.0:1788845935.990469:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1788845935.990472:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2401:x1875740683418368:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845935.990475:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2401:x1875740683418240:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845935.990499:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2401:x1875740683418240:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845935.990500:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2401:x1875740683418368:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845935.990506:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1788845935.990539:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00080000:1.0:1788845935.990560:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788845935.990571:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845935.990574:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845935.990576:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845935.990999:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2401:x1875740683417600:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 1200us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845935.991017:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 305 00000001:02000400:2.0:1788845936.113944:0:12182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788845936.442479:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845936.442713:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845936.442735:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702365696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788845936.442801:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845936.442925:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702365696 00000100:00100000:0.0:1788845936.442934:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702365696 00000100:00100000:0.0:1788845936.442979:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788845936.442988:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702365696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788845936.443020:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788845936.443072:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702365696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845936.443079:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788845936.443162:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702365696:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788845936.957253:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000001:00100000:2.0:1788845936.967455:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00010000:00010000:2.0:1788845937.472628:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845938.491381:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845939.002774:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845939.002798:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702365824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845939.002870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845939.003002:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702365824 00000100:00100000:3.0:1788845939.003012:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702365824 00000100:00100000:3.0:1788845939.003073:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788845939.003084:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702365824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788845939.003114:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845939.003160:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702365824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845939.003167:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788845939.003178:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845939.003186:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702365952:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788845939.003201:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e25180 x1875740702365824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845939.003219:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702365824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788845939.003225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845939.003251:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702365952 00000100:00100000:2.0:1788845939.003255:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702365952 00000100:00100000:2.0:1788845939.003297:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788845939.003299:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845939.003304:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702365952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788845939.003315:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845939.003354:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702365952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845939.003361:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788845939.003374:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47a680 x1875740702365952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845939.003388:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702365952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845939.514780:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702366080:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788845939.514795:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845939.514850:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845939.514890:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702366336:0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.514899:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702366592:0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.514919:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845939.514922:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702366464:0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.514943:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702367104:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.514947:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845939.514962:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702366976:0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.514963:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845939.514981:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845939.514984:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788845939.514996:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702367488:0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.514997:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702366208:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845939.515019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845939.515035:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702366720:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515044:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702366080 00000100:00100000:3.0:1788845939.515051:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702366080 00000100:00100000:0.0:1788845939.515053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845939.515067:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702367232:0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.515083:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845939.515096:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702366464 00000100:00100000:0.0:1788845939.515107:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702366592 00000100:00100000:0.0:1788845939.515110:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702366592 00000100:00100000:3.0:1788845939.515120:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702366464 00000100:00100000:0.0:1788845939.515132:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702367104 00000100:00100000:3.0:1788845939.515133:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702366720 00000100:00100000:3.0:1788845939.515135:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702366720 00000100:00100000:0.0:1788845939.515135:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702367104 00000100:00100000:3.0:1788845939.515149:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788845939.515151:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702366976 00000100:00100000:0.0:1788845939.515153:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702366976 00000100:00100000:3.0:1788845939.515157:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875740702366080:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845939.515162:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702367232 00000100:00100000:0.0:1788845939.515164:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702367232 00000100:00100000:0.0:1788845939.515175:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788845939.515180:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702366592:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1788845939.515188:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788845939.515218:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702366592:12345-0@lo:400:kworker.0 Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515225:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788845939.515227:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3642:x1875740702366080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845939.515233:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788845939.515240:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788845939.515242:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788845939.515245:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702367104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515248:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44981a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702366464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.515269:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702367104:12345-0@lo:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788845939.515282:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44981a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702366464:12345-0@lo:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515285:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788845939.515289:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788845939.515290:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702366976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.515312:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702366976:12345-0@lo:400:kworker.0 Request processed in 22us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515323:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788845939.515332:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788845939.515337:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702367232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.515479:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702367232:12345-0@lo:400:kworker.0 Request processed in 141us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515485:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788845939.515506:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788845939.515512:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702366720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.515561:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702366720:12345-0@lo:400:kworker.0 Request processed in 49us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515566:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788845939.515568:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702367488 00000100:00100000:3.0:1788845939.515571:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702367488 00000100:00100000:3.0:1788845939.515607:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788845939.515611:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702366720:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515615:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702367488:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788845939.515624:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752ae680 x1875740702367232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845939.515634:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702367232:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515642:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702367488:12345-0@lo:400:kworker.0 Request processed in 29us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515644:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702366592:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515648:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788845939.515652:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702367104:0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.515664:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702366080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788845939.515668:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845939.515684:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702366848:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515705:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845939.515721:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702367360:0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.515733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702366336 00000100:00100000:0.0:1788845939.515737:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702366336 00000100:00100000:3.0:1788845939.515739:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845939.515755:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702366848 00000100:00100000:0.0:1788845939.515758:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702366848 00000100:00100000:3.0:1788845939.515763:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702367360 00000100:00100000:3.0:1788845939.515771:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702367360 00000100:00100000:0.0:1788845939.515774:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788845939.515786:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702366336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515793:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788845939.515798:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702367360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845939.515817:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702366336:12345-0@lo:400:kworker.0 Request processed in 32us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845939.515821:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702367360:12345-0@lo:400:kworker.0 Request processed in 24us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515823:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788845939.515827:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788845939.515834:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788845939.515840:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702366848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515851:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702366464:0@lo:400:kworker.0 00010000:00080000:3.0:1788845939.515862:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752ace00 x1875740702366976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845939.515863:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702366848:12345-0@lo:400:kworker.0 Request processed in 24us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845939.515869:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788845939.515871:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702366976:0@lo:400:kworker.0 00010000:00080000:3.0:1788845939.515880:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752afb80 x1875740702367488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845939.515888:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702367488:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515921:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702366336:0@lo:400:kworker.0 00000100:00100000:3.0:1788845939.515934:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702366848:0@lo:400:kworker.0 00010000:00080000:3.0:1788845939.515943:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752aea00 x1875740702367360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845939.515950:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702367360:0@lo:400:kworker.0 00000100:00100000:1.0:1788845939.516636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702366208 00000100:00100000:1.0:1788845939.516644:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702366208 00000100:00100000:1.0:1788845939.516684:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788845939.516691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702366208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845939.516741:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702366208:12345-0@lo:400:kworker.0 Request processed in 50us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845939.516747:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:0.0:1788845939.516783:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845939.516788:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845939.516790:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845939.517227:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702366208:0@lo:400:kworker.0 00000100:00100000:0.0:1788845940.025899:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702367616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788845940.025970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845940.026119:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702367616 00000100:00100000:1.0:1788845940.026127:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702367616 00000100:00100000:1.0:1788845940.026177:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788845940.026186:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702367616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788845940.026221:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845940.026275:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702367616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845940.026281:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1788845940.026565:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752a9180 x1875740702367616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845940.026582:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702367616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845940.027105:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845940.027116:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702367744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845940.027151:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845940.027512:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702367744 00000100:00100000:0.0:1788845940.027542:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702367744 00000100:00100000:0.0:1788845940.027581:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788845940.027588:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702367744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845940.027611:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845940.027654:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702367744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845940.027661:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788845940.027782:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e26d80 x1875740702367744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845940.027796:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702367744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845940.541587:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845941.111323:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845941.111370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845941.111408:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845941.111440:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845941.111460:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845941.111487:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845941.111499:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683418752 00000100:00100000:1.0:1788845941.111553:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845941.111553:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683418752 00000100:00100000:1.0:1788845941.111595:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683419264 00000100:00100000:1.0:1788845941.111600:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683419264 00000100:00100000:0.0:1788845941.111634:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683419008 00000100:00100000:0.0:1788845941.111639:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683419008 00000100:00100000:1.0:1788845941.111642:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683419136 00000100:00100000:1.0:1788845941.111647:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683419136 00000100:00100000:0.0:1788845941.111661:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683418624 00000100:00100000:0.0:1788845941.111666:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683418624 00000100:00100000:1.0:1788845941.111681:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1788845941.111687:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683418880 00000100:00100000:0.0:1788845941.111693:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683418880 00000100:00100000:1.0:1788845941.111694:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683419264:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845941.111713:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:0.0:1788845941.111721:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683418752:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845941.111767:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683419264:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 77us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845941.111775:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:1.0:1788845941.111804:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1788845941.111811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:1.0:1788845941.111817:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683419136:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845941.111827:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683419008:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845941.111893:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683418496 00000100:00100000:3.0:1788845941.111898:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683418496 00000100:00100000:3.0:1788845941.111929:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 307 00000100:00100000:3.0:1788845941.111937:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683418496:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845941.111949:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683418752:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 227us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845941.111957:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:3.0:1788845941.111968:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683418496:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845941.111975:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:0.0:1788845941.111987:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683418624:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845941.111991:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 307 00000100:00100000:0.0:1788845941.112021:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683418624:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 36us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845941.112030:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:3.0:1788845941.112047:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:3.0:1788845941.112059:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683418880:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:0.0:1788845941.112071:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845941.112077:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845941.112080:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845941.112082:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845941.112090:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683418880:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845941.112098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:1.0:1788845941.112392:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683419136:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 578us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845941.112394:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683419008:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 571us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845941.112409:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1788845941.112419:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 144 00010000:00010000:0.0:1788845941.563264:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845941.563726:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702367872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788845941.563790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845941.564104:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702367872 00000100:00100000:3.0:1788845941.564112:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702367872 00000100:00100000:3.0:1788845941.564158:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788845941.564167:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702367872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788845941.564198:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788845941.566343:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702367872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2169us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845941.566357:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788845941.568162:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702367872:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788845942.585740:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788845943.236514:0:12498:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788845943.237152:0:12498:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788845943.609822:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845944.123080:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702368000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845944.123202:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845944.123322:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702368000 00000100:00100000:1.0:1788845944.123334:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702368000 00000100:00100000:1.0:1788845944.123412:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788845944.123424:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46e5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702368000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845944.123479:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845944.123603:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46e5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702368000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 181us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845944.123612:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788845944.123972:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845944.124068:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752aed80 x1875740702368000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845944.124094:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702368000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845944.124372:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702368128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845944.124423:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845944.124514:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702368128 00000100:00100000:0.0:1788845944.124540:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702368128 00000100:00100000:0.0:1788845944.124612:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788845944.124623:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702368128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845944.124639:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845944.124678:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702368128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845944.124685:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788845944.124784:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a4e00 x1875740702368128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845944.124797:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702368128:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788845944.125010:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845944.633790:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702368256:0@lo:400:kworker.0 00000100:00100000:1.0:1788845944.633871:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788845944.633975:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845944.634452:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702368640:0@lo:400:kworker.0 00000100:00100000:0.0:1788845944.634488:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845944.634550:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702368640 00000100:00100000:0.0:1788845944.634557:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702368640 00000100:00100000:0.0:1788845944.634608:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788845944.634615:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702368640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845944.634662:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702368640:12345-0@lo:400:kworker.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845944.634669:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788845944.634706:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702368640:0@lo:400:kworker.0 00000100:00100000:1.0:1788845944.635007:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702368256 00000100:00100000:1.0:1788845944.635013:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702368256 00000100:00100000:1.0:1788845944.635275:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788845944.635283:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702368256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845944.635325:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702368256:12345-0@lo:400:kworker.0 Request processed in 44us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845944.635332:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788845944.635381:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845944.635391:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702368768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845944.635498:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845944.635549:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702368768 00000100:00100000:1.0:1788845944.635554:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702368768 00000100:00100000:1.0:1788845944.635593:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788845944.635600:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702368768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788845944.635624:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845944.635667:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702368768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845944.635673:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788845944.635702:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702368256:0@lo:400:kworker.0 00000100:00100000:1.0:1788845944.635731:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702368768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845944.636247:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702369152:0@lo:400:kworker.0 00000100:00100000:1.0:1788845944.636281:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845944.636392:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845944.636399:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702369280:0@lo:400:kworker.0 00000100:00100000:1.0:1788845944.636497:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.636579:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702368384:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.636614:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702368512:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.636635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.636654:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702369024:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.636678:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702368512 00000100:00100000:3.0:1788845944.636689:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702368512 00000100:00100000:3.0:1788845944.636720:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788845944.636727:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702368512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.636769:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702368512:12345-0@lo:400:kworker.0 Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.636788:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788845944.637097:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702369664:0@lo:400:kworker.0 00000100:00100000:1.0:1788845944.637123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845944.637151:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702369664 00000100:00100000:1.0:1788845944.637155:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702369664 00000100:00100000:1.0:1788845944.637191:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788845944.637197:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702369664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845944.637229:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702369664:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845944.637235:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788845944.637251:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788845944.637281:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752ac700 x1875740702369664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845944.637293:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702369664:0@lo:400:kworker.0 00000100:00100000:0.0:1788845944.637499:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702369152 00000100:00100000:0.0:1788845944.637503:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702369152 00000100:00080000:1.0:1788845944.637590:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845944.637647:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702369280 00000100:00100000:3.0:1788845944.637652:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702369280 00000100:00100000:3.0:1788845944.637679:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788845944.637687:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702369152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.637725:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702369152:12345-0@lo:400:kworker.0 Request processed in 39us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.637732:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788845944.637745:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788845944.637751:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702369280:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788845944.637909:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845944.637938:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702369280:0@lo:400:kworker.0 00010000:00080000:1.0:1788845944.637950:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752aed80 x1875740702369152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845944.637960:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702369152:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638007:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702369280:12345-0@lo:400:kworker.0 Request processed in 256us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.638014:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788845944.638047:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.638216:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702369536:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638243:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.638273:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702368512:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638292:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.638311:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702368896:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638334:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.638348:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702369408:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845944.638400:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702369024 00000100:00100000:3.0:1788845944.638404:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702369024 00000100:00100000:3.0:1788845944.638441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702368384 00000100:00100000:3.0:1788845944.638444:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702368384 00000100:00100000:3.0:1788845944.638457:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702369408 00000100:00100000:3.0:1788845944.638459:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702369408 00000100:00100000:3.0:1788845944.638471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788845944.638477:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702369024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638511:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702369024:12345-0@lo:400:kworker.0 Request processed in 34us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.638533:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788845944.638547:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788845944.638554:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702368384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702368384:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.638613:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788845944.638625:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788845944.638632:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702369408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638659:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702369408:12345-0@lo:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.638665:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788845944.638681:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702369536 00000100:00100000:3.0:1788845944.638684:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702369536 00000100:00100000:3.0:1788845944.638708:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788845944.638714:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702369536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.638744:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702369536:12345-0@lo:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.638756:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788845944.638773:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702368896 00000100:00100000:3.0:1788845944.638954:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702368896 00000100:00100000:3.0:1788845944.638983:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788845944.638990:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702368896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.639021:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702368896:12345-0@lo:400:kworker.0 Request processed in 32us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845944.639040:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788845944.639069:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702369024:0@lo:400:kworker.0 00010000:00080000:3.0:1788845944.639080:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752adf80 x1875740702369536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845944.639218:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702369536:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.639249:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702368384:0@lo:400:kworker.0 00000100:00100000:3.0:1788845944.639259:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702368896:0@lo:400:kworker.0 00010000:00080000:3.0:1788845944.639268:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752aea00 x1875740702369408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845944.639277:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702369408:0@lo:400:kworker.0 00000100:00080000:3.0:1788845944.639299:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845944.639303:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788845944.639305:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:0.0:1788845944.942149:0:12596:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788845944.942391:0:12596:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788845945.147637:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845945.147657:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702369792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845945.147738:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845945.147824:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702369792 00000100:00100000:0.0:1788845945.147832:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702369792 00000100:00100000:0.0:1788845945.147878:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788845945.147887:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702369792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845945.147916:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845945.147964:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702369792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845945.147972:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1788845945.148110:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e341e24e00 x1875740702369792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845945.148128:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e341e24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702369792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845945.148550:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702369920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845945.148855:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845945.149077:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702369920 00000100:00100000:0.0:1788845945.149084:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702369920 00000100:00100000:0.0:1788845945.149118:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788845945.149126:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702369920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788845945.149141:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845945.149234:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702369920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845945.149241:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788845945.149289:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a5f80 x1875740702369920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845945.149304:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702369920:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788845945.658098:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845946.227970:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845946.228205:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845946.228241:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845946.228271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845946.228288:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845946.228302:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845946.228319:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845946.228340:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683420160 00000100:00100000:1.0:1788845946.228348:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683420160 00000100:00100000:1.0:1788845946.228395:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683420032 00000100:00100000:1.0:1788845946.228398:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683420032 00000100:00100000:1.0:1788845946.228419:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1788845946.228429:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683420160:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845946.228494:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683420160:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845946.228502:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1788845946.228562:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:1.0:1788845946.228570:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683420032:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845946.228601:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683420032:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845946.228607:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:1.0:1788845946.228660:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683419648 00000100:00100000:1.0:1788845946.228664:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683419648 00000100:00100000:1.0:1788845946.228690:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683419904 00000100:00100000:1.0:1788845946.228693:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683419904 00000100:00100000:1.0:1788845946.228704:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683419520 00000100:00100000:1.0:1788845946.228706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683419520 00000100:00100000:1.0:1788845946.228717:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683419776 00000100:00100000:1.0:1788845946.228719:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683419776 00000100:00100000:1.0:1788845946.228731:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:1.0:1788845946.228737:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683419648:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845946.228765:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683419648:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845946.228771:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:1.0:1788845946.228783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:1.0:1788845946.228789:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683419904:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845946.228821:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683419904:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845946.228827:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:1.0:1788845946.228839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:1.0:1788845946.228845:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683419520:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845946.228878:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683419520:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845946.228885:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:1.0:1788845946.228897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:1.0:1788845946.228903:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683419776:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845946.228925:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683419776:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845946.228938:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:0.0:1788845946.229598:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683419392 00000100:00100000:0.0:1788845946.229606:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683419392 00000100:00100000:0.0:1788845946.229643:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 309 00000100:00100000:0.0:1788845946.229651:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683419392:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845946.229742:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683419392:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 91us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845946.229760:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 309 00000100:00080000:0.0:1788845946.229803:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845946.229808:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845946.229811:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788845946.229814:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845946.684514:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845946.684628:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702370048:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788845946.684697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845946.684815:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702370048 00000100:00100000:3.0:1788845946.684831:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702370048 00000100:00100000:3.0:1788845946.684985:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788845946.684996:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702370048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788845946.685047:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788845946.685111:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702370048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845946.685119:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788845946.685311:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702370048:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788845946.686343:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788845947.049037:0:12693:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788845947.049266:0:12693:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788845947.706780:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845948.731640:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788845949.230496:0:12790:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788845949.232577:0:12790:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788845949.243771:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845949.243792:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702370176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845949.243889:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845949.243989:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702370176 00000100:00100000:0.0:1788845949.243998:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702370176 00000100:00100000:0.0:1788845949.244061:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845949.244072:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702370176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845949.244099:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845949.244166:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702370176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845949.244173:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788845949.244217:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3a5f80 x1875740702370176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845949.244235:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702370176:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788845949.244289:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845949.244421:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845949.244432:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702370304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845949.244473:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845949.244556:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702370304 00000100:00100000:3.0:1788845949.244561:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702370304 00000100:00100000:3.0:1788845949.244598:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788845949.244605:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702370304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788845949.244616:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845949.244650:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702370304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.244656:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788845949.244682:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752afb80 x1875740702370304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845949.244694:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702370304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788845949.244791:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788845949.754566:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702370688:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.754636:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845949.754687:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702371200:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.754713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845949.754732:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702371712:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.754756:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845949.754786:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788845949.754791:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702370816:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.754829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845949.754851:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702371328:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.754871:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845949.754907:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702370688 00000100:00100000:3.0:1788845949.754915:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702370688 00000100:00100000:3.0:1788845949.754959:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788845949.754967:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702370688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.755018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702370688:12345-0@lo:400:kworker.0 Request processed in 52us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.755025:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788845949.755047:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702371200 00000100:00100000:3.0:1788845949.755051:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702371200 00000100:00100000:3.0:1788845949.755083:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702370816 00000100:00100000:3.0:1788845949.755086:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702370816 00000100:00100000:3.0:1788845949.755101:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702371328 00000100:00100000:3.0:1788845949.755103:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702371328 00000100:00100000:3.0:1788845949.755116:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788845949.755122:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702371200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.755152:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702371200:12345-0@lo:400:kworker.0 Request processed in 30us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.755159:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788845949.755170:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788845949.755176:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702370816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.755199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702370816:12345-0@lo:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.755205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788845949.755214:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788845949.755227:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702371328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.755253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702371328:12345-0@lo:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.755259:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788845949.755276:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702371712 00000100:00100000:3.0:1788845949.755280:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702371712 00000100:00100000:3.0:1788845949.755307:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788845949.755313:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.755344:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702371712:12345-0@lo:400:kworker.0 Request processed in 31us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.755350:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788845949.755374:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845949.755378:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788845949.755380:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845949.755421:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702370816:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.755431:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702371328:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.755439:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702370688:0@lo:400:kworker.0 00010000:00080000:3.0:1788845949.755450:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4751cad80 x1875740702371200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845949.755460:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702371200:0@lo:400:kworker.0 00010000:00080000:3.0:1788845949.755469:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4751ca300 x1875740702371712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845949.755476:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702371712:0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.755588:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702370560:0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.755620:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845949.755637:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702371072:0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.755658:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845949.755671:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702371584:0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.755691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845949.755710:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788845949.755715:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702370432:0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.755741:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845949.755764:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702370944:0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.755785:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845949.755801:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702371456:0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.755820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845949.755845:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702371584 00000100:00100000:1.0:1788845949.755848:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702371584 00000100:00100000:1.0:1788845949.755883:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788845949.755890:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702371584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.755925:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702371584:12345-0@lo:400:kworker.0 Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845949.755932:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788845949.755952:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702370432 00000100:00100000:1.0:1788845949.755955:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702370432 00000100:00100000:1.0:1788845949.755985:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788845949.755991:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702370432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845949.756019:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702370432:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845949.756025:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788845949.756094:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702370432:0@lo:400:kworker.0 00010000:00080000:1.0:1788845949.756106:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4751cb100 x1875740702371584/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845949.756114:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702371584:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.756239:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702370560 00000100:00100000:3.0:1788845949.756249:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702370560 00000100:00100000:3.0:1788845949.756272:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702371072 00000100:00100000:3.0:1788845949.756275:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702371072 00000100:00100000:3.0:1788845949.756290:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702371456 00000100:00100000:3.0:1788845949.756292:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702371456 00000100:00100000:3.0:1788845949.756306:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788845949.756456:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702370560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.756500:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702370560:12345-0@lo:400:kworker.0 Request processed in 187us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.756507:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788845949.756551:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788845949.756559:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702371072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.756587:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702371072:12345-0@lo:400:kworker.0 Request processed in 30us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.756592:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788845949.756603:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788845949.756610:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702371456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.756641:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702371456:12345-0@lo:400:kworker.0 Request processed in 32us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.756647:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1788845949.756669:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788845949.756673:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788845949.756676:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788845949.756696:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4751c9c00 x1875740702371456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845949.756706:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702371456:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.756718:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702370560:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.756737:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702371072:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.756754:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845949.756762:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702371840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788845949.756789:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845949.756813:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702370944 00000100:00100000:3.0:1788845949.756817:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702370944 00000100:00100000:3.0:1788845949.756837:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702371840 00000100:00100000:3.0:1788845949.756839:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702371840 00000100:00100000:3.0:1788845949.756851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788845949.756856:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702370944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.756892:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702370944:12345-0@lo:400:kworker.0 Request processed in 35us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.756898:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788845949.756909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788845949.756915:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702371840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788845949.756937:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788845949.756968:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702371840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845949.756975:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788845949.757000:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702370944:0@lo:400:kworker.0 00000100:00100000:3.0:1788845949.757021:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702371840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788845949.757332:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845950.266665:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702371968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845950.266730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845950.266801:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702371968 00000100:00100000:2.0:1788845950.266808:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702371968 00000100:00100000:2.0:1788845950.266854:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788845950.266863:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702371968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788845950.266889:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845950.266930:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702371968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845950.266938:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1788845950.266983:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47ad80 x1875740702371968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845950.267000:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702371968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845950.267297:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702372096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845950.267330:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845950.268080:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702372096 00000100:00100000:3.0:1788845950.268089:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702372096 00000100:00100000:3.0:1788845950.268237:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788845950.268248:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702372096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845950.268273:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845950.268333:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702372096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845950.268339:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788845950.268396:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47ad80 x1875740702372096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845950.268412:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702372096:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845950.779766:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788845951.164511:0:12888:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788845951.165167:0:12888:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788845951.348157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845951.348205:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845951.348235:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845951.348270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845951.348287:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845951.348303:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683420544 00000100:00100000:1.0:1788845951.348304:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845951.348312:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683420544 00000100:00100000:1.0:1788845951.348323:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845951.348375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683420800 00000100:00100000:0.0:1788845951.348379:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683420800 00000100:00100000:2.0:1788845951.348389:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683420288 00000100:00100000:0.0:1788845951.348392:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683420416 00000100:00100000:2.0:1788845951.348393:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683420288 00000100:00100000:0.0:1788845951.348405:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683420416 00000100:00100000:0.0:1788845951.348419:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683420672 00000100:00100000:2.0:1788845951.348420:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 311 00000100:00100000:0.0:1788845951.348421:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683420672 00000100:00100000:2.0:1788845951.348429:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683420288:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845951.348432:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:0.0:1788845951.348438:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683420544:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845951.348490:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683420544:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 52us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845951.348497:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:0.0:1788845951.348507:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:1.0:1788845951.348510:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683420800:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845951.348562:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:0.0:1788845951.348569:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683420416:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845951.348602:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:3.0:1788845951.348612:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683420672:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845951.351855:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683420288:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 3415us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845951.351869:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 311 00000100:00100000:1.0:1788845951.352485:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683420800:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 3972us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845951.352496:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00080000:1.0:1788845951.353631:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845951.353639:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788845951.355249:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683420928 00000100:00100000:2.0:1788845951.355262:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683420928 00000100:00100000:2.0:1788845951.355336:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683421056 00000100:00100000:2.0:1788845951.355340:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683421056 00000100:00100000:2.0:1788845951.355369:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1788845951.355380:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2397:x1875740683420928:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:2.0:1788845951.355409:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271a51 00000100:00080000:2.0:1788845951.355418:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90e342a23800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788845951.355460:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788845951.356244:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+2:2397:x1875740683420928:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 403us (7474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845951.356254:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1788845951.356276:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1788845951.356286:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2397:x1875740683421056:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:2.0:1788845951.356303:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271a58 00000100:00080000:2.0:1788845951.356310:0:8433:0:(import.c:65:import_set_state_nolock()) ffff90e342a22800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788845951.356342:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788845951.356425:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+2:2397:x1875740683421056:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 141us (8099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845951.356444:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00010000:00010000:2.0:1788845951.356470:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845951.356475:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788845951.357580:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788845951.357588:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845951.357698:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683420416:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 9125us (9423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845951.357709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:3.0:1788845951.358476:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683420672:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 9862us (10182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845951.358485:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:1.0:1788845951.801771:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702372224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788845951.801834:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845951.801934:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702372224 00000100:00100000:2.0:1788845951.801949:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702372224 00000100:00100000:2.0:1788845951.802006:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788845951.802016:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702372224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788845951.802047:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845951.802096:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702372224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845951.802102:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788845951.802238:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702372224:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788845951.802372:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845952.827020:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845953.849984:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845954.361922:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845954.361943:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702372352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845954.362001:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845954.362061:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702372352 00000100:00100000:3.0:1788845954.362067:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702372352 00000100:00100000:3.0:1788845954.362115:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788845954.362126:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702372352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788845954.362154:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845954.362194:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702372352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845954.362200:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788845954.362218:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845954.362243:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458336d80 x1875740702372352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845954.362260:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702372352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845954.363566:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702372480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845954.363622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845954.364100:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702372480 00000100:00100000:0.0:1788845954.364107:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702372480 00000100:00100000:0.0:1788845954.364152:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788845954.364159:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702372480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845954.364175:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845954.367793:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702372480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3626us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.367808:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788845954.368751:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845954.371749:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d329880 x1875740702372480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845954.371778:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702372480:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788845954.407242:0:13033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788845954.873747:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845954.874314:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702372992:0@lo:400:kworker.0 00000100:00100000:2.0:1788845954.874383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845954.874441:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702373504:0@lo:400:kworker.0 00000100:00100000:2.0:1788845954.874478:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845954.874508:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702374016:0@lo:400:kworker.0 00000100:00100000:2.0:1788845954.874560:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845954.874588:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788845954.874595:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702372864:0@lo:400:kworker.0 00000100:00100000:2.0:1788845954.874617:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845954.874634:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702373376:0@lo:400:kworker.0 00000100:00100000:2.0:1788845954.874655:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845954.874676:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702373888:0@lo:400:kworker.0 00000100:00100000:2.0:1788845954.874713:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845954.874744:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702372992 00000100:00100000:2.0:1788845954.874751:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702372992 00000100:00100000:2.0:1788845954.874796:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788845954.874805:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702372992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845954.874869:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702372992:12345-0@lo:400:kworker.0 Request processed in 54us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845954.874877:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788845954.874899:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702374016 00000100:00100000:2.0:1788845954.874903:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702374016 00000100:00100000:2.0:1788845954.874933:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702373888 00000100:00100000:2.0:1788845954.874937:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702373888 00000100:00100000:2.0:1788845954.874960:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788845954.874968:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702374016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845954.875001:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702374016:12345-0@lo:400:kworker.0 Request processed in 34us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875115:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702373120:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845954.875166:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875198:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845954.875220:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788845954.875226:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702372736:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875249:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845954.875265:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702373248:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875286:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845954.875300:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702373760:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845954.875341:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702373504 00000100:00100000:0.0:1788845954.875345:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702373504 00000100:00100000:0.0:1788845954.875367:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702372864 00000100:00100000:0.0:1788845954.875369:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702372864 00000100:00100000:0.0:1788845954.875381:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702373376 00000100:00100000:0.0:1788845954.875384:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702373376 00000100:00100000:0.0:1788845954.875394:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702373120 00000100:00100000:0.0:1788845954.875396:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702373120 00000100:00100000:0.0:1788845954.875405:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702373632 00000100:00100000:0.0:1788845954.875407:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702373632 00000100:00100000:0.0:1788845954.875418:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702373760 00000100:00100000:0.0:1788845954.875420:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702373760 00000100:00100000:0.0:1788845954.875432:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788845954.875438:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702373504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875470:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702373504:12345-0@lo:400:kworker.0 Request processed in 32us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875477:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788845954.875490:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788845954.875508:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702372864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875578:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702372864:12345-0@lo:400:kworker.0 Request processed in 70us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875590:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788845954.875603:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788845954.875609:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702373376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875638:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702373376:12345-0@lo:400:kworker.0 Request processed in 30us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788845954.875654:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788845954.875659:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702373120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875687:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702373120:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788845954.875703:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788845954.875709:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702373632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875733:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702373632:12345-0@lo:400:kworker.0 Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875739:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788845954.875749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788845954.875755:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702373760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702373760:12345-0@lo:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788845954.875800:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702373248 00000100:00100000:0.0:1788845954.875803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702373248 00000100:00100000:0.0:1788845954.875825:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788845954.875831:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702373248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875869:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702373248:12345-0@lo:400:kworker.0 Request processed in 38us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875876:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788845954.875895:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788845954.875903:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702373888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.875931:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702373888:12345-0@lo:400:kworker.0 Request processed in 29us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.875937:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788845954.875979:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702373248:0@lo:400:kworker.0 00010000:00080000:0.0:1788845954.875992:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a4380 x1875740702373760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845954.876014:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702373760:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.876027:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702373120:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.876035:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.876068:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702372864:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.876077:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702373376:0@lo:400:kworker.0 00010000:00080000:0.0:1788845954.876087:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a7b80 x1875740702373888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845954.876096:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702373888:0@lo:400:kworker.0 00000100:00100000:0.0:1788845954.876105:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702372992:0@lo:400:kworker.0 00010000:00080000:0.0:1788845954.876114:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47ad80 x1875740702373504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845954.876128:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702373504:0@lo:400:kworker.0 00010000:00080000:0.0:1788845954.876140:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a6680 x1875740702374016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845954.876148:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702374016:0@lo:400:kworker.0 00000100:00080000:0.0:1788845954.876187:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845954.876191:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845954.876194:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845954.876681:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702372736 00000100:00100000:1.0:1788845954.876687:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702372736 00000100:00100000:1.0:1788845954.876730:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788845954.876739:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702372736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845954.876786:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702372736:12345-0@lo:400:kworker.0 Request processed in 49us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845954.876793:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788845954.876834:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702372736:0@lo:400:kworker.0 00000100:00100000:1.0:1788845954.877953:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788845954.877970:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702372608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845954.878087:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845954.878179:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702372608 00000100:00100000:0.0:1788845954.878186:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702372608 00000100:00100000:0.0:1788845954.878231:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788845954.878238:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702372608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788845954.878267:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788845954.878314:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702372608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845954.878320:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788845954.878575:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702372608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845954.879107:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788845955.385771:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702374144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845955.385825:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702374272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845955.385845:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845955.385868:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702374144 00000100:00100000:2.0:1788845955.385876:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702374144 00000100:00100000:2.0:1788845955.385930:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845955.385939:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702374144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788845955.385967:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845955.389560:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702374144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3612us (3705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845955.389576:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1788845955.390667:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a7800 x1875740702374144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845955.390691:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702374144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788845955.391643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845955.391746:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702374272 00000100:00100000:3.0:1788845955.391756:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702374272 00000100:00100000:3.0:1788845955.391831:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788845955.391840:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702374272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788845955.391861:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845955.391916:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702374272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845955.391922:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788845955.391971:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f474a80 x1875740702374272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845955.391986:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702374272:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788845955.898956:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845956.464953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845956.468450:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683421312 00000100:00100000:1.0:1788845956.468475:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683421312 00000100:00100000:1.0:1788845956.468596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 173 00000100:00100000:1.0:1788845956.468609:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683421312:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845956.468705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683421312:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 99us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845956.468713:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 173 00000100:00080000:0.0:1788845956.468906:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845956.471191:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845956.471232:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845956.471253:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845956.471327:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845956.471357:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683421440 00000100:00100000:0.0:1788845956.471365:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683421440 00000100:00100000:0.0:1788845956.471406:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683421696 00000100:00100000:0.0:1788845956.471409:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683421696 00000100:00100000:0.0:1788845956.471422:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683421568 00000100:00100000:0.0:1788845956.471424:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683421568 00000100:00100000:0.0:1788845956.471438:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:0.0:1788845956.471446:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683421440:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845956.471548:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683421440:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845956.471556:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:0.0:1788845956.471573:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00100000:0.0:1788845956.471580:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683421696:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845956.471774:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683421184 00000100:00100000:2.0:1788845956.471785:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683421184 00000100:00100000:2.0:1788845956.471815:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 313 00000100:00100000:2.0:1788845956.471823:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683421184:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845956.471853:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683421184:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845956.471860:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 313 00000100:00100000:2.0:1788845956.471891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:2.0:1788845956.471898:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683421568:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845956.471923:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683421568:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845956.471930:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:0.0:1788845956.472368:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683421696:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 787us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845956.472375:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00080000:0.0:1788845956.472392:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845956.472397:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788845956.923711:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845956.923904:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702374400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788845956.923983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845956.924173:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702374400 00000100:00100000:2.0:1788845956.924180:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702374400 00000100:00100000:2.0:1788845956.924236:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788845956.924245:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702374400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788845956.924289:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845956.924350:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702374400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845956.924357:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788845956.924879:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702374400:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788845956.927298:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000020:00000080:2.0:1788845956.927307:0:8426:0:(genops.c:885:class_export_put()) final put ffff90e342a26000/d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000020:00000080:1.0:1788845956.927467:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342a26000/d427c55d-013b-49aa-ae4d-d3c385e9b3d8 for lustre-OST0000 00000020:00000080:1.0:1788845956.927555:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342a23800 for lustre-OST0000 00000001:00100000:3.0:1788845956.930076:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000020:00000080:3.0:1788845956.930084:0:9508:0:(genops.c:885:class_export_put()) final put ffff90e342a20800/d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000020:00000080:0.0:1788845956.930264:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342a20800/d427c55d-013b-49aa-ae4d-d3c385e9b3d8 for lustre-OST0001 00000020:00000080:0.0:1788845956.930317:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342a22800 for lustre-OST0001 00000020:00000080:1.0:1788845957.588987:0:13181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0d8055f0 20000000:00000080:1.0:1788845957.589003:0:13181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e46f375400 uarg=0000000000000000 20000000:01000000:1.0:1788845957.589039:0:13181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788845957.589044:0:13181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788845957.589099:0:13181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788845957.590252:0:13182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788845957.590486:0:13181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788845957.597854:0:13181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788845957.598207:0:13181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598229:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598238:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d561382719f6 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598245:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a04 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598252:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a12 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598258:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a20 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598278:0:13181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598286:0:13181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598325:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598352:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 12 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.598367:0:13181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702374528:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788845957.598465:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271a20 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598484:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271a20 expref: 23 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.598494:0:13181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702374656:0@lo:104: 00000100:00100000:1.0:1788845957.598554:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845957.598591:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271a12 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598598:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271a12 expref: 23 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.598605:0:13181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702374784:0@lo:104: 00000100:00100000:1.0:1788845957.598632:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845957.598653:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271a04 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598661:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271a04 expref: 23 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.598667:0:13181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702374912:0@lo:104: 00000100:00100000:1.0:1788845957.598683:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845957.598696:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d561382719f6 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598703:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d561382719f6 expref: 23 pid: 6508 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.598709:0:13181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702375040:0@lo:104: 00000100:00100000:1.0:1788845957.598736:0:13181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845957.598751:0:13181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.598759:0:13181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 12 pid: 6508 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.598768:0:13181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702375168:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788845957.598787:0:13181:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341082540 going to sleep for 11 seconds 00000100:00100000:0.0:1788845957.599218:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702374656 00000100:00100000:0.0:1788845957.599226:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702374656 00000100:00100000:0.0:1788845957.599262:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702374784 00000100:00100000:0.0:1788845957.599264:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702374784 00000100:00100000:0.0:1788845957.599272:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702374912 00000100:00100000:0.0:1788845957.599274:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702374912 00000100:00100000:0.0:1788845957.599292:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702375040 00000100:00100000:0.0:1788845957.599295:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702375040 00000100:00100000:0.0:1788845957.599307:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788845957.599314:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:13181:x1875740702374656:12345-0@lo:104: 00010000:00010000:0.0:1788845957.599325:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845957.600772:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845957.600786:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:13181:x1875740702374656:12345-0@lo:104: Request processed in 1469us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845957.600796:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788845957.600825:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788845957.600834:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:13181:x1875740702374784:12345-0@lo:104: 00010000:00010000:0.0:1788845957.600848:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845957.600897:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788845957.600902:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:13181:x1875740702374784:12345-0@lo:104: Request processed in 71us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845957.600908:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788845957.600920:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788845957.600926:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:13181:x1875740702374912:12345-0@lo:104: 00010000:00010000:0.0:1788845957.600934:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845957.600963:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788845957.600968:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:13181:x1875740702374912:12345-0@lo:104: Request processed in 43us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845957.600987:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788845957.600999:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788845957.601004:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:13181:x1875740702375040:12345-0@lo:104: 00010000:00010000:0.0:1788845957.601011:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845957.601040:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788845957.601045:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:13181:x1875740702375040:12345-0@lo:104: Request processed in 41us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845957.601050:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788845957.601222:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788845957.601229:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601238:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845957.601242:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601250:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845957.601257:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845957.601264:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788845957.601302:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601309:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845957.601390:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601398:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138271a20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a27 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601412:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788845957.601415:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601420:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065c00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845957.601422:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601435:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845957.601441:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845957.601446:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788845957.601461:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601465:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845957.601471:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601491:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475065c00/0x21b4d56138271a12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601499:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788845957.601502:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601507:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845957.601510:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601516:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845957.601547:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845957.601559:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788845957.601574:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601580:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845957.601596:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601602:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3000/0x21b4d56138271a04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a0b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601611:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845957.601614:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601619:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3c00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788845957.601621:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601627:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788845957.601632:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845957.601637:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788845957.601648:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601653:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788845957.601664:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601670:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d561382719f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d561382719fd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.601682:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845957.601683:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845957.601685:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845957.601692:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845957.601697:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845957.601709:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702375296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845957.601757:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845957.601796:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845957.601802:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702375424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845957.601825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845957.601854:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702375552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845957.601876:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845957.601892:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845957.601897:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702375680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788845957.601915:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845957.601937:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702375296 00000100:00100000:3.0:1788845957.601944:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702375296 00010000:00010000:3.0:1788845957.601969:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a20 expref: 24 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845957.601986:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702375424 00000100:00100000:3.0:1788845957.601988:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702375424 00010000:00010000:3.0:1788845957.601998:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a12 expref: 25 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845957.602016:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702375552 00000100:00100000:3.0:1788845957.602019:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702375552 00010000:00010000:3.0:1788845957.602030:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a04 expref: 26 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845957.602041:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702375680 00000100:00100000:3.0:1788845957.602043:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702375680 00010000:00010000:3.0:1788845957.603186:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382719f6 expref: 27 pid: 6508 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845957.603211:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845957.603219:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+27:3640:x1875740702375296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845957.603231:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845957.603237:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a20 expref: 27 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.603247:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271a20 expref: 27 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.603265:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845957.603321:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+27:3640:x1875740702375296:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845957.603328:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788845957.603810:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845957.603820:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+26:3640:x1875740702375424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845957.603830:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845957.603835:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a12 expref: 26 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.603859:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271a12 expref: 26 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.603870:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845957.603898:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+26:3640:x1875740702375424:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (2072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845957.603904:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788845957.603917:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845957.603924:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+25:3642:x1875740702375552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845957.603931:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845957.603935:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a04 expref: 25 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.603943:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271a04 expref: 25 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.603952:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845957.603978:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+25:3642:x1875740702375552:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845957.603983:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788845957.603995:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788845957.604001:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702375680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845957.604008:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845957.604012:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d561382719f6 expref: 24 pid: 6508 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.604020:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d561382719f6 expref: 24 pid: 6508 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845957.604036:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845957.604231:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702375680:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845957.604237:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845957.604329:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702375680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845957.604349:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702375552:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788845957.604599:0:13181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271a20 expref: 23 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845957.604610:0:13181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702374656:0@lo:104: 00010000:00010000:2.0:1788845957.604621:0:13181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c800/0x21b4d56138271a19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271a12 expref: 22 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845957.604637:0:13181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702374784:0@lo:104: 00010000:00010000:2.0:1788845957.604651:0:13181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d000/0x21b4d56138271a0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271a04 expref: 21 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845957.604659:0:13181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702374912:0@lo:104: 00010000:00010000:2.0:1788845957.604669:0:13181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42dc00/0x21b4d561382719fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d561382719f6 expref: 20 pid: 6508 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845957.604676:0:13181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702375040:0@lo:104: 00000100:00100000:0.0:1788845957.604880:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702375424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845957.604889:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702375296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845957.607886:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845957.607929:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845957.608202:0:13181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702374528:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788845957.608215:0:13181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13181:1875740702375168:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788845957.608251:0:13181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.608307:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683421952 00000100:00100000:1.0:1788845957.608315:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683421952 00010000:00010000:1.0:1788845957.608358:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 13 pid: 6508 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.608410:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683421824 00000100:00100000:1.0:1788845957.608414:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683421824 00010000:00010000:1.0:1788845957.608427:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 14 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845957.608440:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1788845957.608447:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22bfafdd-07c8-48a2-8d88-9be191aa000d+14:2399:x1875740683421952:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845957.608461:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845957.608467:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 14 pid: 6508 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608487:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 14 pid: 6508 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608504:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0da00/0x21b4d561382719ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754434 expref: 14 pid: 6508 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608551:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845957.608597:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683421952:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 150us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845957.608604:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:1.0:1788845957.608621:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:1.0:1788845957.608628:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:2399:x1875740683421824:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788845957.608636:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788845957.608641:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 12 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608661:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 12 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608671:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138271a3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754473 expref: 12 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608681:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608688:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608702:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.608709:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.609022:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.609028:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.609034:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788845957.609038:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.609165:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845957.609496:0:13181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845957.609505:0:13181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.618164:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.618182:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138271a5f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845957.618214:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788845957.618302:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:2399:x1875740683421824:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 9669us (10367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845957.618313:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00010000:00010000:3.0:1788845957.948803:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788845958.905599:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845958.905608:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e342932800 from 7 10000000:01000000:0.0:1788845958.905614:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845958.905665:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.905678:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.905689:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845958.905728:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702375808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.905793:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845958.905857:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702375808 00000100:00100000:2.0:1788845958.905866:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702375808 00000100:00100000:0.0:1788845958.905866:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845958.905923:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788845958.905933:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702375808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845958.905945:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845958.905959:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271a66 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845958.905989:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271a66 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845958.905999:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a66 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845958.906009:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c600, rc 0) 00000100:00100000:2.0:1788845958.906057:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702375808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845958.906063:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788845958.906272:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702375808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845958.906287:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.906296:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845958.906351:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702375936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.906378:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.906400:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845958.906446:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702375936 00000100:00100000:1.0:1788845958.906451:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702375936 00000100:00100000:1.0:1788845958.906496:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788845958.906504:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702375936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845958.906658:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702375936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845958.906665:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788845958.906740:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702375936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.906772:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.906811:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.906837:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845958.906880:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702376064 00000100:00100000:1.0:1788845958.906885:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702376064 00000100:00100000:1.0:1788845958.906912:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788845958.906919:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702376064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845958.907102:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702376064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845958.907109:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788845958.907186:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788845958.910347:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788845958.910632:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788845958.910657:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845958.910668:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.910679:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845958.910704:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845958.910707:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451767800 from 7 10000000:01000000:0.0:1788845958.910710:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845958.910745:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.910753:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.910763:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845958.910786:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.910844:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.911197:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845958.911757:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702376192 00000100:00100000:1.0:1788845958.911778:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702376192 00000100:00100000:1.0:1788845958.911830:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788845958.911849:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702376192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845958.911864:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845958.911889:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271a74 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845958.911925:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271a74 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845958.911935:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a74 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845958.911945:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3400, rc 0) 00000100:00100000:1.0:1788845958.912004:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702376192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845958.912010:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788845958.912051:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845958.912067:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.912077:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845958.912136:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.912164:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.912189:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845958.912271:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702376320 00000100:00100000:2.0:1788845958.912280:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702376320 00000100:00100000:2.0:1788845958.912315:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788845958.912323:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702376320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845958.912443:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702376320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845958.912450:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788845958.912485:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.912641:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.912688:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.912902:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845958.914178:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702376448 00000100:00100000:1.0:1788845958.914187:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702376448 00000100:00100000:1.0:1788845958.914266:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788845958.914274:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702376448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845958.914397:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702376448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845958.914405:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788845958.914498:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788845958.919855:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788845958.920024:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788845958.920051:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788845958.920062:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.920073:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845958.920083:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788845958.920086:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47518c000 from 7 10000000:01000000:0.0:1788845958.920088:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788845958.920121:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.920128:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.920138:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845958.920162:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.920222:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.920257:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845958.920343:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702376576 00000100:00100000:2.0:1788845958.920350:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702376576 00000100:00100000:2.0:1788845958.920398:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788845958.920406:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702376576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845958.920419:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845958.920431:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271a82 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845958.920453:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271a82 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845958.920489:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a82 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845958.920497:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42da00, rc 0) 00000100:00100000:2.0:1788845958.920559:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702376576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845958.920566:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788845958.920654:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845958.920668:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.920683:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845958.920733:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.920758:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.920773:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788845958.921214:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702376704 00000100:00100000:1.0:1788845958.921219:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702376704 00000100:00100000:1.0:1788845958.921253:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788845958.921261:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702376704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845958.921404:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702376704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845958.921419:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788845958.922071:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.922111:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.922156:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.922217:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4753156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845958.922250:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702376832 00000100:00100000:3.0:1788845958.922256:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702376832 00000100:00100000:3.0:1788845958.922326:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788845958.922334:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702376832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845958.922479:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702376832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845958.922487:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788845958.923025:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788845958.923834:0:13215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788845958.924304:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788845958.924326:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788845958.924337:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845958.924348:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845958.924358:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845958.924361:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451417000 from 7 10000000:01000000:1.0:1788845958.924363:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845958.924394:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845958.924402:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845958.924412:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845958.924433:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845958.924499:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845958.924565:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341082000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845958.924682:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702376960 00000100:00100000:0.0:1788845958.924689:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702376960 00000100:00100000:0.0:1788845958.924722:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788845958.924729:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702376960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845958.924740:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845958.924751:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271a90 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.924772:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271a90 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.924781:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a90 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.924804:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0dc00, rc 0) 00000100:00100000:0.0:1788845958.924838:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702376960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845958.924845:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788845958.924925:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702376960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845958.924937:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845958.924946:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845958.925004:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702377088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845958.925029:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845958.925056:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341082000 going to sleep for 11 seconds 00000100:00100000:0.0:1788845958.925103:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702377088 00000100:00100000:0.0:1788845958.925108:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702377088 00000100:00100000:0.0:1788845958.925137:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788845958.925143:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702377088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.925250:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702377088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845958.925257:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788845958.925286:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702377088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.925311:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702377216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.925348:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845958.925362:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315900 going to sleep for 11 seconds 00000100:00100000:0.0:1788845958.925373:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702377216 00000100:00100000:0.0:1788845958.925377:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702377216 00000100:00100000:0.0:1788845958.925392:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788845958.925397:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702377216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845958.925850:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702377216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 449us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845958.925857:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788845958.926102:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702377216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788845958.926957:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788845958.927067:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788845958.927086:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788845958.927095:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845958.927105:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845958.970560:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845959.087102:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845959.087208:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683422080 00000100:00100000:2.0:1788845959.087219:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683422080 00000100:00100000:2.0:1788845959.087280:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 326 00000100:00100000:2.0:1788845959.087290:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:6169:x1875740683422080:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845959.087308:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845959.087326:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544a4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845959.087355:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845959.087367:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845959.087375:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d600, rc 0) 00000100:00100000:2.0:1788845959.087442:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683422080:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 145us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845959.087448:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 326 00000100:00100000:3.0:1788845959.095845:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845959.099577:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683422208 00000100:00100000:1.0:1788845959.099593:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683422208 00000100:00100000:2.0:1788845959.099797:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 327 00000100:00100000:2.0:1788845959.099811:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683422208:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845959.099970:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683422208:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 163us (4133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845959.099978:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 327 00000100:00100000:3.0:1788845959.107597:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845959.107690:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683422336 00000100:00100000:1.0:1788845959.107699:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683422336 00000100:00100000:1.0:1788845959.107753:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 328 00000100:00100000:1.0:1788845959.107763:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683422336:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845959.107904:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683422336:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 141us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.107912:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 328 00000100:00100000:2.0:1788845959.120662:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845959.121238:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683422464 00000100:00100000:1.0:1788845959.121249:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683422464 00000100:00100000:1.0:1788845959.121312:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 329 00000100:00100000:1.0:1788845959.121323:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683422464:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845959.121349:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845959.121367:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845959.121403:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845959.121414:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845959.121423:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3200, rc 0) 00000100:00100000:1.0:1788845959.121495:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683422464:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 174us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.121501:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 329 00000100:00100000:3.0:1788845959.128566:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845959.128684:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683422592 00000100:00100000:1.0:1788845959.128694:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683422592 00000100:00100000:1.0:1788845959.128747:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 330 00000100:00100000:1.0:1788845959.128758:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683422592:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845959.128905:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683422592:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 149us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.128913:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 330 00000100:00100000:3.0:1788845959.138705:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845959.138843:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683422720 00000100:00100000:1.0:1788845959.138853:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683422720 00000100:00100000:1.0:1788845959.138900:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 331 00000100:00100000:1.0:1788845959.138909:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683422720:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845959.139037:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683422720:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.139052:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 331 00000100:00100000:3.0:1788845959.483645:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702377344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845959.483712:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845959.483795:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702377344 00000100:00100000:3.0:1788845959.483802:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702377344 00000100:00100000:3.0:1788845959.483856:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788845959.483867:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702377344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788845959.483897:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845959.483940:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702377344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845959.483955:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788845959.483976:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845959.484021:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4751ca300 x1875740702377344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845959.484038:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702377344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845959.484400:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702377472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845959.484430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845959.484509:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702377472 00000100:00100000:0.0:1788845959.484514:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702377472 00000100:00100000:0.0:1788845959.484573:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788845959.484580:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702377472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788845959.484591:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845959.484625:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702377472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845959.484632:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788845959.484687:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845959.484707:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f474700 x1875740702377472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845959.484720:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702377472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845959.994226:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845959.994248:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702377600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845959.994324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845959.994385:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702377600 00000100:00100000:1.0:1788845959.994392:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702377600 00000100:00100000:1.0:1788845959.994435:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788845959.994444:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702377600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788845959.994485:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845959.994558:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702377600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.994565:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00010000:1.0:1788845959.994616:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845959.994646:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702377600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845959.995344:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845959.995357:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702377728:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.995394:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845959.995429:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702377728 00000100:00100000:2.0:1788845959.995434:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702377728 00000100:00100000:0.0:1788845959.995576:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702377856:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.995642:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788845959.995651:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702377728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.995687:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702377728:12345-0@lo:400:kworker.0 Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845959.995693:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788845959.995725:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702378112:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.995747:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845959.995765:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702378624:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.995787:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845959.995829:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702379136:0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.995854:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845959.996201:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845959.996238:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f476d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702377728:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.996254:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788845959.996378:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702378624 00000100:00100000:1.0:1788845959.996383:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702378624 00000100:00100000:1.0:1788845959.996412:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702379136 00000100:00100000:1.0:1788845959.996415:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702379136 00000100:00100000:1.0:1788845959.996445:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788845959.996452:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702378624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845959.996502:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702378624:12345-0@lo:400:kworker.0 Request processed in 50us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.996509:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788845959.996540:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788845959.996547:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702379136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845959.996573:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702379136:12345-0@lo:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.996586:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788845959.996601:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845959.996656:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702378240:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.996685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845959.996711:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702378752:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.996733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788845959.996759:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458335180 x1875740702378624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845959.996770:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702378624:0@lo:400:kworker.0 00010000:00080000:2.0:1788845959.996780:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47b100 x1875740702379136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845959.996788:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702379136:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.996810:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702378112 00000100:00100000:2.0:1788845959.996814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702378112 00000100:00100000:2.0:1788845959.996841:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788845959.996848:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702378112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.996885:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702378112:12345-0@lo:400:kworker.0 Request processed in 37us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845959.996891:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788845959.996906:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702377856 00000100:00100000:2.0:1788845959.996909:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702377856 00000100:00100000:2.0:1788845959.996931:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702378240 00000100:00100000:2.0:1788845959.996933:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702378240 00000100:00100000:2.0:1788845959.996952:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702378752 00000100:00100000:2.0:1788845959.996955:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702378752 00000100:00100000:2.0:1788845959.996967:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788845959.996973:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702377856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.997002:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702377856:12345-0@lo:400:kworker.0 Request processed in 29us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845959.997008:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788845959.997025:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788845959.997031:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702378240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.997058:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702378240:12345-0@lo:400:kworker.0 Request processed in 27us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845959.997064:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788845959.997161:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788845959.997169:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702378752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845959.997201:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702378752:12345-0@lo:400:kworker.0 Request processed in 33us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845959.997207:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1788845959.997438:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845959.997476:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702378240:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.997486:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702378752:0@lo:400:kworker.0 00000100:00100000:2.0:1788845959.997495:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702378112:0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.997785:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702377856:0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.997793:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702378368:0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.997820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845959.997845:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702378880:0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.997866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845959.997889:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788845959.997895:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702377984:0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.997916:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845959.997932:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702378496:0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.997954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845959.997969:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702379008:0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.997989:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845959.998017:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702378496 00000100:00100000:0.0:1788845959.998022:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702378496 00000100:00100000:0.0:1788845959.998043:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702379008 00000100:00100000:0.0:1788845959.998050:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702379008 00000100:00100000:0.0:1788845959.998089:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788845959.998097:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702378496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.998134:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702378496:12345-0@lo:400:kworker.0 Request processed in 39us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845959.998141:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788845959.998153:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845959.998159:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702379008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.998186:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702379008:12345-0@lo:400:kworker.0 Request processed in 27us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845959.998191:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788845959.998210:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702378368 00000100:00100000:0.0:1788845959.998214:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702378368 00000100:00100000:0.0:1788845959.998236:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702378880 00000100:00100000:0.0:1788845959.998239:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702378880 00000100:00100000:0.0:1788845959.998253:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702377984 00000100:00100000:0.0:1788845959.998256:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702377984 00000100:00100000:0.0:1788845959.998434:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788845959.998441:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702378368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.998485:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702378368:12345-0@lo:400:kworker.0 Request processed in 43us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845959.998491:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788845959.998502:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788845959.998508:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702378880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.998553:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702378880:12345-0@lo:400:kworker.0 Request processed in 46us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845959.998559:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788845959.998578:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788845959.998584:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702377984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845959.998613:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702377984:12345-0@lo:400:kworker.0 Request processed in 29us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845959.998619:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1788845959.998635:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845959.998639:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845959.998662:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702377984:0@lo:400:kworker.0 00010000:00080000:0.0:1788845959.998674:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458334e00 x1875740702378496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845959.998684:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702378496:0@lo:400:kworker.0 00010000:00080000:0.0:1788845959.998693:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47a680 x1875740702379008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845959.998700:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702379008:0@lo:400:kworker.0 00010000:00080000:0.0:1788845959.998708:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458335880 x1875740702378368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845959.998716:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702378368:0@lo:400:kworker.0 00010000:00080000:0.0:1788845959.998725:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f47ad80 x1875740702378880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845959.998731:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702378880:0@lo:400:kworker.0 00000100:00100000:3.0:1788845960.505716:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702379264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845960.505784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845960.505928:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702379264 00000100:00100000:3.0:1788845960.505935:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702379264 00000100:00100000:3.0:1788845960.505982:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788845960.505992:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702379264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788845960.506019:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845960.506642:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702379264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 649us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845960.506651:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788845960.506678:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702379392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845960.506706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845960.506773:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702379392 00000100:00100000:3.0:1788845960.506787:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702379392 00000100:00100000:3.0:1788845960.506822:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788845960.506830:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702379392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845960.506843:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845960.506884:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702379392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845960.506891:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788845960.506925:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e9c00 x1875740702379264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845960.506943:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702379264:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788845960.506944:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4751c9c00 x1875740702379392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845960.506955:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702379392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788845961.022125:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788845961.226457:0:13380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788845961.588165:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845961.588200:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845961.588220:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683422848 00000100:00100000:0.0:1788845961.588235:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683422848 00000100:00100000:1.0:1788845961.588292:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845961.588339:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 333 00000100:00100000:0.0:1788845961.588352:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2401:x1875740683422848:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845961.588421:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683422976 00000100:00100000:2.0:1788845961.588428:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683422976 00000100:00100000:3.0:1788845961.588476:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683423104 00000100:00100000:3.0:1788845961.588482:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683423104 00000100:00100000:2.0:1788845961.588490:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:2.0:1788845961.588501:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683422976:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845961.588548:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:3.0:1788845961.588620:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683423104:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845961.588667:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2401:x1875740683422848:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 317us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845961.588675:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 333 00000100:00100000:1.0:1788845961.589028:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845961.589140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845961.589170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683423232 00000100:00100000:1.0:1788845961.589175:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683423232 00000100:00100000:1.0:1788845961.589197:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683423360 00000100:00100000:1.0:1788845961.589200:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683423360 00000100:00100000:1.0:1788845961.589214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:1.0:1788845961.589220:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683423232:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845961.589255:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683423232:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845961.589261:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:1.0:1788845961.589273:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:1.0:1788845961.589287:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683423360:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845961.589313:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683423360:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845961.589427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00080000:1.0:1788845961.589892:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788845961.589896:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845961.591342:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683423104:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2778us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845961.591353:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:2.0:1788845961.593026:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683422976:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 4519us (4816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845961.593038:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:1.0:1788845962.042215:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702379520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788845962.042291:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845962.042487:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702379520 00000100:00100000:2.0:1788845962.042495:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702379520 00010000:00010000:0.0:1788845962.042537:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845962.042570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788845962.042581:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702379520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788845962.042613:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845962.042668:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702379520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845962.042922:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788845962.042989:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702379520:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788845963.065847:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788845964.091598:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845964.603714:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702379648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845964.603831:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845964.603930:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702379648 00000100:00100000:3.0:1788845964.603939:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702379648 00000100:00100000:3.0:1788845964.603999:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788845964.604011:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702379648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845964.604200:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845964.604255:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702379648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 246us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845964.604263:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788845964.604289:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845964.604335:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4751c9c00 x1875740702379648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845964.604359:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4751c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702379648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845964.604660:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845964.604670:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702379776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845964.604709:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845964.604814:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702379776 00000100:00100000:1.0:1788845964.604819:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702379776 00000100:00100000:1.0:1788845964.604860:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788845964.604868:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702379776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845964.604882:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845964.604916:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702379776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845964.604922:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788845964.604940:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845964.604960:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438eb800 x1875740702379776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845964.604974:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702379776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788845965.114019:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702380160:0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.114119:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845965.114371:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702379904:0@lo:400:kworker.0 00000100:00100000:1.0:1788845965.114442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845965.114478:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788845965.114485:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702380032:0@lo:400:kworker.0 00000100:00100000:1.0:1788845965.114512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845965.114777:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702380544:0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.114812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845965.114837:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845965.114842:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702380416:0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.114865:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845965.114898:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702380160 00000100:00100000:3.0:1788845965.114908:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702380160 00000100:00100000:0.0:1788845965.115512:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702380672:0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.115572:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845965.115604:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845965.115612:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702380288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845965.115692:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845965.115797:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702380544 00000100:00100000:0.0:1788845965.115803:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702380544 00000100:00100000:0.0:1788845965.115849:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702380288 00000100:00100000:0.0:1788845965.115852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702380288 00000100:00100000:0.0:1788845965.115876:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788845965.115885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788845965.115896:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875740702380288:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788845965.115947:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702380544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.116008:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702380544:12345-0@lo:400:kworker.0 Request processed in 122us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845965.116016:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788845965.116035:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788845965.116041:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875740702380160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.116078:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875740702380160:12345-0@lo:400:kworker.0 Request processed in 37us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845965.116084:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788845965.116129:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702380160:0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.116200:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702380032 00000100:00100000:0.0:1788845965.116205:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702380032 00000100:00100000:0.0:1788845965.116235:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702380416 00000100:00100000:0.0:1788845965.116238:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702380416 00000100:00100000:0.0:1788845965.116258:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702380672 00000100:00100000:0.0:1788845965.116260:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702380672 00000100:00100000:0.0:1788845965.116287:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788845965.116294:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702380032:12345-0@lo:400:kworker.0 00000004:00000024:3.0:1788845965.116318:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788845965.116336:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702380032:12345-0@lo:400:kworker.0 Request processed in 41us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845965.116344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788845965.116359:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788845965.116368:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702380416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.116373:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702380288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 477us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845965.116381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788845965.116409:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788845965.116411:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702380416:12345-0@lo:400:kworker.0 Request processed in 43us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845965.116433:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702380672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.116435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788845965.116464:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702379904 00000100:00100000:0.0:1788845965.116470:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702379904 00000100:00100000:3.0:1788845965.116473:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702380672:12345-0@lo:400:kworker.0 Request processed in 55us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845965.116492:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788845965.116505:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788845965.116514:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702379904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.116573:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702380416:0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.116581:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702379904:12345-0@lo:400:kworker.0 Request processed in 69us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845965.116589:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788845965.116671:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702380544:0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.116686:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702380032:0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.116704:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702379904:0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.116716:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702380288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788845965.116730:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702380672:0@lo:400:kworker.0 00000100:00080000:0.0:1788845965.116802:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845965.118696:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845965.118723:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702380800:0@lo:400:kworker.0 00000100:00100000:2.0:1788845965.118843:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702381056:0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.118895:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845965.118914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845965.118945:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702381184:0@lo:400:kworker.0 00000100:00100000:2.0:1788845965.118946:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702381568:0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.118961:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702381312:0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.118987:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845965.118993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845965.119013:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845965.119027:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788845965.119037:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702380928:0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.119040:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702380800 00000100:00100000:3.0:1788845965.119050:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702380800 00000100:00100000:0.0:1788845965.119066:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702381184 00000100:00100000:2.0:1788845965.119071:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845965.119072:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702381184 00000100:00100000:2.0:1788845965.119098:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e458335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702381440:0@lo:400:kworker.0 00000100:00100000:2.0:1788845965.119122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788845965.119141:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845965.119177:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702381056 00000100:00100000:1.0:1788845965.119182:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702381056 00000100:00100000:1.0:1788845965.119214:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702381568 00000100:00100000:1.0:1788845965.119217:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702381568 00000100:00100000:1.0:1788845965.119229:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702380928 00000100:00100000:1.0:1788845965.119232:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702380928 00000100:00100000:0.0:1788845965.119248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702381312 00000100:00100000:1.0:1788845965.119250:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702381440 00000100:00100000:1.0:1788845965.119255:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702381440 00000100:00100000:0.0:1788845965.119256:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702381312 00000100:00100000:1.0:1788845965.119277:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788845965.119290:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702381056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.119290:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788845965.119302:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702380800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.119358:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702380800:12345-0@lo:400:kworker.0 Request processed in 59us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845965.119367:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702381056:12345-0@lo:400:kworker.0 Request processed in 80us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845965.119371:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788845965.119380:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788845965.119397:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788845965.119401:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788845965.119409:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702381184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845965.119413:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702381568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.119463:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702381184:12345-0@lo:400:kworker.0 Request processed in 57us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845965.119472:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702381568:12345-0@lo:400:kworker.0 Request processed in 62us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845965.119473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788845965.119483:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788845965.119495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788845965.119501:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788845965.119506:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702381312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845965.119512:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702380928:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788845965.119552:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845965.119560:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845965.119564:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788845965.119585:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702381312:12345-0@lo:400:kworker.0 Request processed in 81us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845965.119594:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702380928:12345-0@lo:400:kworker.0 Request processed in 83us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845965.119595:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00080000:2.0:1788845965.119604:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458334700 x1875740702381056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845965.119625:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702381056:0@lo:400:kworker.0 00000100:00100000:1.0:1788845965.119628:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788845965.119645:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458334e00 x1875740702381312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788845965.119647:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f474700 x1875740702381568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845965.119652:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788845965.119664:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702381440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845965.119681:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702381568:0@lo:400:kworker.0 00000100:00100000:0.0:1788845965.119682:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702381312:0@lo:400:kworker.0 00000100:00100000:1.0:1788845965.119711:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702381440:12345-0@lo:400:kworker.0 Request processed in 49us (587us total) trans 0 rc 0/0 00010000:00080000:2.0:1788845965.119716:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458335180 x1875740702380928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845965.119721:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788845965.119744:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702380928:0@lo:400:kworker.0 00010000:00080000:2.0:1788845965.119756:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458335880 x1875740702381440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845965.119772:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702381440:0@lo:400:kworker.0 00000100:00100000:1.0:1788845965.121920:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702381184:0@lo:400:kworker.0 00010000:00080000:1.0:1788845965.121947:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e458334a80 x1875740702380800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845965.121959:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e458334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702380800:0@lo:400:kworker.0 00000100:00100000:3.0:1788845965.626256:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702381696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845965.626357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845965.626465:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702381696 00000100:00100000:3.0:1788845965.626475:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702381696 00000100:00100000:3.0:1788845965.626576:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788845965.626587:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702381696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845965.626627:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845965.629787:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845965.629815:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702381824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845965.629912:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845965.629985:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702381824 00000100:00100000:2.0:1788845965.629997:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702381824 00000100:00100000:2.0:1788845965.630066:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788845965.630077:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702381824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788845965.630105:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788845965.630154:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702381824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845965.630162:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788845965.630207:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e475c11180 x1875740702381824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845965.630229:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702381824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845965.631037:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702381696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4445us (4673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845965.631049:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1788845965.631271:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4752ac000 x1875740702381696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845965.631290:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702381696:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788845966.105774:0:13531:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:39:25 (1788845965) === 00010000:00010000:0.0:1788845966.143204:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845966.238734:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845966.238815:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845966.238878:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683423488 00000100:00100000:1.0:1788845966.238878:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683423616 00000100:00100000:3.0:1788845966.238891:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683423488 00000100:00100000:1.0:1788845966.238891:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683423616 00000100:00100000:3.0:1788845966.238959:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1788845966.238959:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1788845966.238970:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683423488:12345-192.168.203.20@tcp:41:mkdir.0 00000100:00100000:1.0:1788845966.238976:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:10484:x1875740683423616:12345-192.168.203.20@tcp:700:mkdir.0 00000100:00080000:2.0:1788845966.239071:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845966.239086:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:10484:x1875740683423616:12345-192.168.203.20@tcp:700:mkdir.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845966.239094:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000004:00000024:3.0:1788845966.239123:0:7876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788845966.239487:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683423488:12345-192.168.203.20@tcp:41:mkdir.0 Request processed in 517us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845966.239494:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:2.0:1788845966.246038:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845966.246096:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683423872 00000100:00100000:2.0:1788845966.246119:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683423872 00000100:00100000:2.0:1788845966.246189:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1788845966.246201:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:10484:x1875740683423872:12345-192.168.203.20@tcp:36:mkdir.0 00010000:00010000:2.0:1788845966.246277:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788845966.246508:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d5613827194e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175441f expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.246574:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342864000) 00010000:00010000:2.0:1788845966.246592:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845966.246836:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.246851:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.246862:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.246877:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.246885:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.246891:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.247962:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.247978:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.247994:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845966.248013:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c4bb141 reply state 0000000001361158 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248024:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248031:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3900) 00010000:00010000:2.0:1788845966.248035:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788845966.248038:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788845966.248044:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788845966.248052:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248058:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248065:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248072:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788845966.248076:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248084:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248093:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:2.0:1788845966.248096:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845966.248108:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248115:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271aac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845966.248136:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c4bb141 reply state 0000000001361158 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248144:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.248151:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90e3424a3600) 00010000:00010000:2.0:1788845966.248153:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788845966.248155:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788845966.248269:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:10484:x1875740683423872:12345-192.168.203.20@tcp:36:mkdir.0 Request processed in 2067us (2253us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788845966.248279:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1788845966.261693:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845966.261790:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683424000 00000100:00100000:3.0:1788845966.261806:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683424000 00000100:00100000:3.0:1788845966.261892:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1788845966.261903:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:10485:x1875740683424000:12345-192.168.203.20@tcp:101:chmod.0 00010000:00010000:3.0:1788845966.261928:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845966.261960:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271ac1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544b2 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.262212:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ac8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.262229:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.262245:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845966.262298:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788845966.262303:0:12145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788845966.262351:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.262381:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271ac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544b2 expref: 9 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.263723:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544b2 expref: 8 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.263735:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770300) 00010000:00010000:3.0:1788845966.263739:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845966.263743:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788845966.264114:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:10485:x1875740683424000:12345-192.168.203.20@tcp:101:chmod.0 Request processed in 2209us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845966.264125:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1788845966.268235:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845966.268339:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683424256 00000100:00100000:3.0:1788845966.268352:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683424256 00000100:00100000:3.0:1788845966.268550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:3.0:1788845966.268564:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:10485:x1875740683424256:12345-192.168.203.20@tcp:36:chmod.0 00010000:00010000:3.0:1788845966.268636:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845966.268671:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ac8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544b2 expref: 8 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.268693:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770300) 00010000:00010000:3.0:1788845966.268705:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845966.268734:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.268749:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.268761:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788845966.269292:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005335ae5d reply state 0000000082519328 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.269310:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.269319:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770800) 00010000:00010000:3.0:1788845966.269322:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788845966.269326:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788845966.269337:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788845966.269674:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:10485:x1875740683424256:12345-192.168.203.20@tcp:36:chmod.0 Request processed in 1111us (1451us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788845966.269683:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788845966.303634:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.303727:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683424384 00000100:00100000:1.0:1788845966.303740:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683424384 00000100:00100000:1.0:1788845966.303800:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:1.0:1788845966.303811:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:10486:x1875740683424384:12345-192.168.203.20@tcp:101:chown.0 00010000:00010000:1.0:1788845966.303833:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845966.303854:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544b9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.304515:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271add lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.305011:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.305023:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845966.305068:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788845966.305072:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788845966.305109:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271add lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.305137:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544b9 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.305154:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271add lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544b9 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.305173:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770800) 00010000:00010000:1.0:1788845966.305176:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845966.305180:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3600, rc 0) 00000100:00100000:1.0:1788845966.305238:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:10486:x1875740683424384:12345-192.168.203.20@tcp:101:chown.0 Request processed in 1429us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845966.305246:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:1.0:1788845966.309224:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845966.309352:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683424512 00000100:00100000:3.0:1788845966.309361:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683424512 00000100:00100000:3.0:1788845966.309429:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1788845966.309440:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:10486:x1875740683424512:12345-192.168.203.20@tcp:101:chown.0 00010000:00010000:3.0:1788845966.309459:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845966.309479:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544c0 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309566:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309581:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309592:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309620:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309629:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309636:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309707:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271af9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309716:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309722:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788845966.309761:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788845966.309765:0:12145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788845966.309782:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309794:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309799:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309805:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309819:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788845966.309824:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309831:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309841:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770800) 00010000:00010000:3.0:1788845966.309844:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845966.309849:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309854:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309867:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309872:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309877:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309892:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788845966.309895:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.309901:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.310096:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90e3424a3600) 00010000:00010000:3.0:1788845966.310100:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845966.310105:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.310111:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271af2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.310143:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544c0 expref: 12 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.310157:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271af9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544c0 expref: 11 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.310236:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3900) 00010000:00010000:3.0:1788845966.310239:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788845966.310242:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065e00, rc 0) 00000100:00100000:3.0:1788845966.310305:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:10486:x1875740683424512:12345-192.168.203.20@tcp:101:chown.0 Request processed in 867us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845966.310313:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1788845966.315041:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.315495:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683424640 00000100:00100000:1.0:1788845966.315511:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683424640 00000100:00100000:1.0:1788845966.315586:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1788845966.315596:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:10486:x1875740683424640:12345-192.168.203.20@tcp:900:chown.0 00000100:00100000:1.0:1788845966.315674:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:10486:x1875740683424640:12345-192.168.203.20@tcp:900:chown.0 Request processed in 79us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845966.315682:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1788845966.321067:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845966.321609:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683424896 00000100:00100000:3.0:1788845966.321619:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683424896 00000100:00100000:3.0:1788845966.321684:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1788845966.321695:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:10486:x1875740683424896:12345-192.168.203.20@tcp:36:chown.0 00010000:00010000:3.0:1788845966.321747:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845966.321778:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271af9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544c0 expref: 11 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.321803:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3900) 00010000:00010000:3.0:1788845966.321808:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788845966.321830:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.321843:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.321852:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788845966.330319:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1788845966.330456:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d883af5 reply state 000000007c785944 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.330477:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.330487:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3900) 00010000:00010000:3.0:1788845966.330489:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788845966.330493:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788845966.330506:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788845966.330613:0:6515:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788845966.330630:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:10486:x1875740683424896:12345-192.168.203.20@tcp:36:chown.0 Request processed in 8933us (9567us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788845966.330638:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00010000:00010000:3.0:1788845966.330702:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.330711:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.330730:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.330737:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788845966.330741:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.330750:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.330762:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3900) 00010000:00010000:3.0:1788845966.330764:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788845966.330768:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845966.330775:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065600/0x21b4d56138271b00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332168:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332183:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332190:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332195:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845966.332200:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332207:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332221:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90e3424a3600) 00010000:00010000:0.0:1788845966.332224:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845966.332227:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332234:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ab3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332251:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332258:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332264:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332277:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42dc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845966.332280:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332286:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332293:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3900) 00010000:00010000:0.0:1788845966.332296:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845966.332298:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332304:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271aba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332317:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332323:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.332329:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.333486:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845966.333492:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.333501:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.333538:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770800) 00010000:00010000:0.0:1788845966.333541:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788845966.333545:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.333552:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271acf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845966.351499:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.351571:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683425024 00000100:00100000:1.0:1788845966.351581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683425024 00000100:00100000:1.0:1788845966.351633:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:1.0:1788845966.351643:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:10487:x1875740683425024:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:1.0:1788845966.351666:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845966.351685:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271b07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544c7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845966.356116:0:6516:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4381us 00010000:00010000:2.0:1788845966.380563:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380586:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380599:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380615:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380623:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380643:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380766:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138271b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380775:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138271b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380783:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138271b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845966.380811:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788845966.380815:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788845966.380866:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138271b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380887:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380894:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380901:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.380908:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788845966.380912:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381081:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381103:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770800) 00010000:00010000:2.0:1788845966.381106:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845966.381111:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381117:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271b0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381130:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381136:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381142:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381147:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788845966.381150:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381156:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381163:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90e3424a3100) 00010000:00010000:2.0:1788845966.381166:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845966.381169:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381174:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271b15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381222:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271b07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544c7 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381238:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138271b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544c7 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.381245:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:2.0:1788845966.381248:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788845966.381250:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c200, rc 0) 00000100:00100000:2.0:1788845966.381323:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:10487:x1875740683425024:12345-192.168.203.20@tcp:101:touch.500 Request processed in 29680us (29830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845966.381333:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:3.0:1788845966.384262:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.384332:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683425280 00000100:00100000:1.0:1788845966.384341:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683425280 00000100:00100000:1.0:1788845966.384404:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1788845966.384429:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:10487:x1875740683425280:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:1.0:1788845966.384450:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845966.384471:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271b23 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544ce expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.384636:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.384663:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.384674:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.384737:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.384745:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.384752:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788845966.385303:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788845966.385461:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385471:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385479:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385510:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385517:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385730:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385745:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788845966.385749:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385757:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385771:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:1.0:1788845966.385774:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845966.385779:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385785:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788845966.385797:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b47afc5 reply state 000000007f5167b1 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385808:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385814:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff90e342864200) 00010000:00010000:1.0:1788845966.385816:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788845966.385819:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788845966.385851:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271b23 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ce expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.385865:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ce expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.386030:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e342864a00) 00010000:00010000:1.0:1788845966.386032:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845966.386035:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3c00, rc 0) 00000100:00100000:1.0:1788845966.386143:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:10487:x1875740683425280:12345-192.168.203.20@tcp:101:touch.500 Request processed in 1729us (1888us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788845966.386151:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:3.0:1788845966.389222:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845966.389314:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683425536 00000100:00100000:0.0:1788845966.389324:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683425536 00000100:00100000:0.0:1788845966.389382:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1788845966.389392:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:10487:x1875740683425536:12345-192.168.203.20@tcp:36:touch.500 00010000:00010000:0.0:1788845966.389461:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845966.389486:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ce expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.389505:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e342864a00) 00010000:00010000:0.0:1788845966.389514:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845966.389600:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.389624:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.389634:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845966.389735:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ab1e689 reply state 0000000001957e4d transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.389765:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.389772:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e45a2dc700) 00010000:00010000:0.0:1788845966.389774:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788845966.389777:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788845966.389863:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:10487:x1875740683425536:12345-192.168.203.20@tcp:36:touch.500 Request processed in 472us (648us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788845966.389871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1788845966.392246:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.392491:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683425664 00000100:00100000:1.0:1788845966.392501:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683425664 00000100:00100000:1.0:1788845966.393185:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:1.0:1788845966.393197:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:10487:x1875740683425664:12345-192.168.203.20@tcp:101:touch.500 00010000:00010000:1.0:1788845966.393220:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845966.393239:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271b4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544d5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.393307:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544d5 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.393323:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544d5 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.393351:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e45a2dc700) 00010000:00010000:1.0:1788845966.393355:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788845966.393359:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3e00, rc 0) 00000100:00100000:1.0:1788845966.393436:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:10487:x1875740683425664:12345-192.168.203.20@tcp:101:touch.500 Request processed in 242us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845966.393456:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:3.0:1788845966.396242:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845966.396481:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683425792 00000100:00100000:0.0:1788845966.396492:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683425792 00000100:00100000:0.0:1788845966.396746:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1788845966.396754:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875740683425792:12345-192.168.203.20@tcp:8:touch.500 00010000:00080000:0.0:1788845966.396790:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:0.0:1788845966.396821:0:8430:0:(genops.c:1385:class_connect()) connect: client 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635, cookie 0x21b4d56138271b54 00002000:00100000:0.0:1788845966.396835:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635/ffff90e4437d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788845966.396844:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788845966.396938:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788845966.396967:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e47f428800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788845966.397026:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2397:x1875740683425792:12345-192.168.203.20@tcp:8:touch.500 Request processed in 271us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845966.397034:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1788845966.405771:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845966.405856:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683425920 00000100:00100000:0.0:1788845966.405866:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683425920 00000100:00080000:2.0:1788845966.406009:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845966.406058:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788845966.406071:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:0:x1875740683425920:12345-192.168.203.20@tcp:2:touch.500 00000001:00080000:2.0:1788845966.410846:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1788845966.410860:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000100:00100000:0.0:1788845966.411248:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:0:x1875740683425920:12345-192.168.203.20@tcp:2:touch.500 Request processed in 5175us (5480us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788845966.411259:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:2.0:1788845966.414457:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845966.414574:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683426176 00000100:00100000:3.0:1788845966.414584:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683426176 00000100:00100000:3.0:1788845966.414718:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1788845966.414729:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:10487:x1875740683426176:12345-192.168.203.20@tcp:35:touch.500 00000100:00100000:3.0:1788845966.415116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:10487:x1875740683426176:12345-192.168.203.20@tcp:35:touch.500 Request processed in 389us (667us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788845966.415140:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1788845966.432184:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.432633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683426304 00000100:00100000:1.0:1788845966.432644:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683426304 00000100:00100000:1.0:1788845966.432703:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1788845966.432713:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:10488:x1875740683426304:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:1.0:1788845966.432737:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845966.432756:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544dc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.432819:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271b62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.432832:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.432852:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845966.433111:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788845966.433116:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788845966.433151:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271b62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.433189:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544dc expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.433206:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271b62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544dc expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.433234:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:1.0:1788845966.433237:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788845966.433241:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2c00, rc 0) 00000100:00100000:1.0:1788845966.433460:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:10488:x1875740683426304:12345-192.168.203.20@tcp:101:rm.0 Request processed in 746us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845966.433467:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1788845966.441699:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845966.441807:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683426560 00000100:00100000:2.0:1788845966.441817:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683426560 00000100:00100000:0.0:1788845966.441976:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:0.0:1788845966.441990:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:10488:x1875740683426560:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:0.0:1788845966.442011:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845966.442043:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271b69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544e3 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845966.442142:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788845966.442280:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271b69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544e3 expref: 16 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.442294:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770800) 00010000:00010000:0.0:1788845966.442297:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788845966.442302:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271b69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544e3 expref: 16 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.442316:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0ca00, rc 0) 00000100:00100000:0.0:1788845966.442377:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:10488:x1875740683426560:12345-192.168.203.20@tcp:101:rm.0 Request processed in 391us (686us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788845966.442393:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:2.0:1788845966.450135:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845966.450217:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683426688 00000100:00100000:0.0:1788845966.450226:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683426688 00000100:00100000:0.0:1788845966.450284:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1788845966.450295:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:10488:x1875740683426688:12345-192.168.203.20@tcp:37:rm.0 00000100:00100000:0.0:1788845966.456458:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:10488:x1875740683426688:12345-192.168.203.20@tcp:37:rm.0 Request processed in 6142us (6308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845966.456472:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1788845966.465873:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845966.466003:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683426944 00000100:00100000:3.0:1788845966.466013:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683426944 00000100:00100000:3.0:1788845966.466072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1788845966.466083:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:10488:x1875740683426944:12345-192.168.203.20@tcp:35:rm.0 00000100:00100000:3.0:1788845966.466308:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:10488:x1875740683426944:12345-192.168.203.20@tcp:35:rm.0 Request processed in 226us (443us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788845966.466315:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:2.0:1788845966.471045:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.471376:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683427200 00000100:00100000:1.0:1788845966.471397:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683427200 00000100:00100000:1.0:1788845966.471618:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1788845966.471629:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:10488:x1875740683427200:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:1.0:1788845966.471655:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845966.471674:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544ea expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.471774:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.471789:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.471801:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845966.471811:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788845966.471919:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138271b77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ea expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.471951:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ea expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.471960:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:1.0:1788845966.471962:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788845966.471965:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3c00, rc 0) 00000100:00100000:1.0:1788845966.472027:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:10488:x1875740683427200:12345-192.168.203.20@tcp:101:rm.0 Request processed in 400us (989us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788845966.472034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:3.0:1788845966.477617:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845966.488704:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683427328 00000100:00100000:0.0:1788845966.488720:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683427328 00000100:00100000:0.0:1788845966.488796:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:0.0:1788845966.488806:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:10488:x1875740683427328:12345-192.168.203.20@tcp:41:rm.0 00000004:00000024:0.0:1788845966.488984:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788845966.489098:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:10488:x1875740683427328:12345-192.168.203.20@tcp:41:rm.0 Request processed in 293us (11499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845966.489106:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1788845966.494601:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.494691:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683427456 00000100:00100000:1.0:1788845966.494701:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683427456 00000100:00100000:1.0:1788845966.494752:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:1.0:1788845966.494763:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:10488:x1875740683427456:12345-192.168.203.20@tcp:101:rm.0 00010000:00010000:1.0:1788845966.494783:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788845966.494803:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271b8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544f1 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.494876:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.494890:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.494901:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.494912:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.494932:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.494940:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495053:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441443600/0x21b4d56138271ba1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495062:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441443600/0x21b4d56138271ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495069:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441443600/0x21b4d56138271ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788845966.495106:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788845966.495110:0:12145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788845966.495127:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441443600/0x21b4d56138271ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495138:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441443600/0x21b4d56138271ba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495145:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495151:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495157:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495173:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788845966.495178:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495185:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495197:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:1.0:1788845966.495199:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845966.495204:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495210:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271b93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495222:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495229:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495234:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495240:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441442400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788845966.495242:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495249:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495266:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff90e342864200) 00010000:00010000:1.0:1788845966.495268:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788845966.495271:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495278:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441442400/0x21b4d56138271b9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495366:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271b8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544f1 expref: 20 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495381:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441443600/0x21b4d56138271ba1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544f1 expref: 19 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.495389:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e45a2dc700) 00010000:00010000:1.0:1788845966.495392:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788845966.495394:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441443600, rc 0) 00000100:00100000:1.0:1788845966.495713:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:10488:x1875740683427456:12345-192.168.203.20@tcp:101:rm.0 Request processed in 950us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845966.495721:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:1.0:1788845966.504213:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845966.504399:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683427712 00000100:00100000:0.0:1788845966.504409:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683427712 00000100:00100000:0.0:1788845966.504492:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:0.0:1788845966.504502:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:10488:x1875740683427712:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:0.0:1788845966.504582:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788845966.504611:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441443600/0x21b4d56138271ba1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544f1 expref: 19 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504635:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271b4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544d5 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504646:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e45a2dc700) 00010000:00010000:0.0:1788845966.504655:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271b62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544dc expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504683:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:0.0:1788845966.504687:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788845966.504707:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504720:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504729:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504739:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504746:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504752:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504852:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504860:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.504867:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845966.505076:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788845966.505085:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350542563778ns, next at 351542561890ns, rc = 0 00010000:00010000:0.0:1788845966.505152:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505171:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505179:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505186:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505192:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505198:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505214:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788845966.505230:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505236:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505241:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505246:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845966.505250:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505257:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505271:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e45a2dc700) 00010000:00010000:0.0:1788845966.505274:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788845966.505278:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505283:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c000/0x21b4d56138271bb6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.505568:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788845966.505576:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.505582:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788845966.505585:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.505601:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.505611:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e45a2dc700) 00010000:00010000:1.0:1788845966.505613:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788845966.505616:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.505621:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138271bbd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845966.505632:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845966.505634:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845966.505635:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845966.505813:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505822:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505828:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.505832:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0ca00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845966.506025:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.506033:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.506042:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:0.0:1788845966.506044:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845966.506047:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.506053:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d56138271ba8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788845966.506075:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000993e4a33 reply state 00000000e8d0dad8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.506086:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845966.506093:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff90e342864200) 00010000:00010000:0.0:1788845966.506094:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788845966.506097:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845966.506284:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:10488:x1875740683427712:12345-192.168.203.20@tcp:36:rm.0 Request processed in 1780us (2075us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788845966.506292:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1788845966.513591:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.513685:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683427968 00000100:00100000:1.0:1788845966.513695:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683427968 00000100:00100000:1.0:1788845966.513754:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1788845966.513764:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:10488:x1875740683427968:12345-192.168.203.20@tcp:35:rm.0 00000100:00100000:1.0:1788845966.514003:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:10488:x1875740683427968:12345-192.168.203.20@tcp:35:rm.0 Request processed in 240us (421us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788845966.514011:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:1.0:1788845966.517892:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845966.519154:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683428224 00000100:00100000:2.0:1788845966.519182:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683428224 00000100:00100000:2.0:1788845966.519252:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1788845966.519263:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:10488:x1875740683428224:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:2.0:1788845966.519322:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788845966.519348:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271b7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ea expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519370:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138271b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544c7 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519381:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:2.0:1788845966.519395:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271add lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544b9 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519403:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451770800) 00010000:00010000:2.0:1788845966.519409:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788845966.519441:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519453:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519462:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519475:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519482:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519516:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519632:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519640:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.519647:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845966.519873:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788845966.520062:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520070:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520076:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520082:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788845966.520087:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520094:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520103:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff90e3424a3700) 00010000:00010000:2.0:1788845966.520106:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788845966.520118:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520124:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271bd2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520144:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520150:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520155:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520160:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788845966.520162:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520168:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520175:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3100) 00010000:00010000:2.0:1788845966.520177:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788845966.520180:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520186:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271bc4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788845966.520196:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085ee2b32 reply state 00000000ed043214 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520217:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845966.520223:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90e3424a3400) 00010000:00010000:2.0:1788845966.520226:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788845966.520228:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788845966.520317:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:10488:x1875740683428224:12345-192.168.203.20@tcp:36:rm.0 Request processed in 1054us (2442us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788845966.520325:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1788845966.706091:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845966.706136:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845966.706181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845966.706248:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683428352 00000100:00100000:0.0:1788845966.706257:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683428352 00000100:00100000:0.0:1788845966.706305:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 335 00000100:00100000:0.0:1788845966.706315:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683428352:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845966.706381:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683428352:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 68us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845966.706400:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 335 00000100:00100000:2.0:1788845966.706652:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845966.707161:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683428608 00000100:00100000:1.0:1788845966.707168:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683428608 00000100:00100000:1.0:1788845966.707274:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683428480 00000100:00100000:1.0:1788845966.707278:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683428480 00000100:00100000:3.0:1788845966.707309:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683428736 00000100:00100000:3.0:1788845966.707316:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683428736 00000100:00080000:2.0:1788845966.707322:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788845966.707328:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845966.707385:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:2.0:1788845966.707396:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683428608:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845966.707468:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683428608:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 75us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845966.707475:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:2.0:1788845966.707506:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:2.0:1788845966.707513:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683428736:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845966.707558:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683428736:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 46us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845966.707564:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:2.0:1788845966.707590:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:2.0:1788845966.707595:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e458334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683428480:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845966.707619:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e458334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683428480:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845966.707625:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:0.0:1788845967.161733:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702381952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788845967.161805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845967.162435:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702381952 00000100:00100000:1.0:1788845967.162443:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702381952 00000100:00100000:1.0:1788845967.162499:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788845967.162516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702381952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788845967.162580:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788845967.164574:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702381952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2052us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845967.164586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00010000:1.0:1788845967.164649:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845967.169770:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702381952:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788845968.188464:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845969.209677:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845969.721792:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702382080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845969.721890:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845969.722018:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702382080 00000100:00100000:1.0:1788845969.722028:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702382080 00000100:00100000:1.0:1788845969.722113:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788845969.722125:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702382080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845969.722171:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845969.722226:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702382080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845969.722233:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788845969.722286:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788845969.722316:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343937800 x1875740702382080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845969.722339:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702382080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845969.722676:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788845969.722691:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702382208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788845969.722727:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845969.722945:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702382208 00000100:00100000:3.0:1788845969.722951:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702382208 00000100:00100000:3.0:1788845969.723007:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788845969.723014:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702382208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845969.723028:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845969.723069:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702382208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845969.723084:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788845969.723119:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e450c1b100 x1875740702382208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845969.723132:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702382208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788845969.723188:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788845970.233772:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845970.235761:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702382336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845970.235863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845970.236279:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702382336 00000100:00100000:1.0:1788845970.236289:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702382336 00000100:00100000:1.0:1788845970.236351:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788845970.236374:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702382336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788845970.236428:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788845970.236494:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702382336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845970.236547:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788845970.236605:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702382336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845970.237000:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702382464:0@lo:400:kworker.0 00000100:00100000:1.0:1788845970.237049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845970.237171:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702382464 00000100:00100000:0.0:1788845970.237177:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702382464 00000100:00100000:0.0:1788845970.237214:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788845970.237221:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702382464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845970.238290:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702382592:0@lo:400:kworker.0 00000100:00100000:3.0:1788845970.238347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845970.238400:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702383104:0@lo:400:kworker.0 00000100:00100000:3.0:1788845970.238424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845970.238440:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702383616:0@lo:400:kworker.0 00000100:00100000:3.0:1788845970.238463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845970.238487:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788845970.238506:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702382976:0@lo:400:kworker.0 00000100:00100000:3.0:1788845970.238552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845970.238569:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702383488:0@lo:400:kworker.0 00000100:00100000:3.0:1788845970.238591:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845970.238625:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702382592 00000100:00100000:2.0:1788845970.238803:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702383104 00000100:00100000:2.0:1788845970.238811:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702383104 00000100:00100000:2.0:1788845970.238872:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702383616 00000100:00100000:2.0:1788845970.238876:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702383616 00000100:00100000:2.0:1788845970.238906:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702382976 00000100:00100000:2.0:1788845970.238909:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702382976 00000100:00100000:2.0:1788845970.238923:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702383488 00000100:00100000:2.0:1788845970.238926:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702383488 00000100:00100000:2.0:1788845970.238942:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788845970.238951:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702383104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239019:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702383104:12345-0@lo:400:kworker.0 Request processed in 69us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.239026:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788845970.239045:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788845970.239051:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239078:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702383616:12345-0@lo:400:kworker.0 Request processed in 28us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.239091:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788845970.239103:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788845970.239109:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702382976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239151:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702382976:12345-0@lo:400:kworker.0 Request processed in 42us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.239157:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788845970.239170:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788845970.239175:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702383488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239197:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702383488:12345-0@lo:400:kworker.0 Request processed in 23us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.239202:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788845970.239252:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702382976:0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239264:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702383488:0@lo:400:kworker.0 00010000:00080000:2.0:1788845970.239277:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad5180 x1875740702383104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845970.239288:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702383104:0@lo:400:kworker.0 00010000:00080000:2.0:1788845970.239298:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad7800 x1875740702383616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845970.239306:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702383616:0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239341:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702382720:0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845970.239399:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702383232:0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239427:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845970.239448:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702383744:0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239469:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845970.239514:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788845970.239543:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702382848:0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239571:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845970.239590:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702383360:0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239611:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845970.239628:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702383872:0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845970.239673:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702382720 00000100:00100000:2.0:1788845970.239678:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702382720 00000100:00100000:2.0:1788845970.239706:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788845970.239713:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702382720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.239748:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702382720:12345-0@lo:400:kworker.0 Request processed in 36us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.239755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788845970.239785:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702382720:0@lo:400:kworker.0 00000100:00100000:3.0:1788845970.240260:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702382592 00000100:00100000:3.0:1788845970.240309:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788845970.240319:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702382592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845970.240382:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702382592:12345-0@lo:400:kworker.0 Request processed in 66us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845970.240398:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788845970.243993:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702382592:0@lo:400:kworker.0 00000100:00100000:0.0:1788845970.244174:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702382464:12345-0@lo:400:kworker.0 Request processed in 6950us (7121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845970.244203:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788845970.244285:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702383232 00000100:00100000:0.0:1788845970.244294:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702383232 00000100:00100000:0.0:1788845970.244335:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702383744 00000100:00100000:0.0:1788845970.244339:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702383744 00000100:00100000:0.0:1788845970.244485:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702383360 00000100:00100000:0.0:1788845970.244489:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702383360 00000100:00100000:0.0:1788845970.244504:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702383872 00000100:00100000:0.0:1788845970.244506:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702383872 00000100:00100000:2.0:1788845970.244591:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702382848 00000100:00100000:2.0:1788845970.244596:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702382848 00000100:00100000:2.0:1788845970.244645:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788845970.244656:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702382848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.244750:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702382848:12345-0@lo:400:kworker.0 Request processed in 96us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.244757:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788845970.244778:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788845970.244786:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702383232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.244831:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702383232:12345-0@lo:400:kworker.0 Request processed in 46us (5403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.244838:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788845970.244851:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845970.244857:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702383744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.244885:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702383744:12345-0@lo:400:kworker.0 Request processed in 28us (5414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.244890:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788845970.244901:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788845970.244907:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702383360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.244935:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702383360:12345-0@lo:400:kworker.0 Request processed in 30us (5324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.244942:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788845970.244954:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788845970.244960:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702383872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845970.244988:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702383872:12345-0@lo:400:kworker.0 Request processed in 29us (5339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845970.244994:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788845970.245011:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845970.245017:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845970.245021:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788845970.245053:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702382848:0@lo:400:kworker.0 00010000:00080000:2.0:1788845970.245069:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad5880 x1875740702383360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845970.245081:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702383360:0@lo:400:kworker.0 00010000:00080000:2.0:1788845970.245103:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3af480 x1875740702383872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845970.245112:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702383872:0@lo:400:kworker.0 00010000:00080000:2.0:1788845970.245124:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad4a80 x1875740702383232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845970.245132:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702383232:0@lo:400:kworker.0 00010000:00080000:2.0:1788845970.245143:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3ac700 x1875740702383744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845970.245152:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702383744:0@lo:400:kworker.0 00000100:00100000:1.0:1788845970.247600:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702382464:0@lo:400:kworker.0 00000001:02000400:3.0:1788845970.535616:0:13678:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:0.0:1788845970.749474:0:9823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354786950948ns, next at 355786948147ns, rc = 0 00000100:00100000:3.0:1788845970.749552:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788845970.749579:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702384000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845970.749646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845970.749819:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702384000 00000100:00100000:3.0:1788845970.749827:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702384000 00000100:00100000:3.0:1788845970.749879:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788845970.749888:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702384000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845970.749916:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845970.749961:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702384000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845970.749968:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1788845970.750003:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4e00 x1875740702384000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845970.750022:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702384000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845970.750177:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845970.750188:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702384128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845970.750219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845970.750309:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702384128 00000100:00100000:0.0:1788845970.750314:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702384128 00000100:00100000:0.0:1788845970.750345:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788845970.750352:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702384128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788845970.750363:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845970.750473:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702384128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845970.750480:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788845970.751360:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343936a00 x1875740702384128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845970.751375:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702384128:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788845971.263305:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788845971.611031:0:13726:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec8298ca0 20000000:00000080:3.0:1788845971.611059:0:13726:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e47b559400 uarg=0000000000000000 20000000:01000000:3.0:1788845971.611120:0:13726:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788845971.611129:0:13726:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788845971.611135:0:13726:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788845971.612273:0:13727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788845971.612492:0:13726:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788845971.618367:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788845971.618442:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788845971.618457:0:13726:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788845971.618476:0:13726:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788845971.618501:0:13726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618565:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a66 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618599:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a74 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618607:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a82 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618614:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271a90 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618625:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618632:0:13726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618639:0:13726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618691:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618708:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 12 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.618726:0:13726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384256:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788845971.618875:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618884:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.618901:0:13726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384384:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788845971.618938:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271a90 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.618947:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271a90 expref: 23 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.618957:0:13726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384512:0@lo:104: 00000100:00100000:3.0:1788845971.619008:0:13726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845971.619039:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271a82 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.619047:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271a82 expref: 23 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.619055:0:13726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384640:0@lo:104: 00010000:00010000:3.0:1788845971.619080:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271a74 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.619088:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271a74 expref: 23 pid: 6509 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.619096:0:13726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384768:0@lo:104: 00010000:00010000:3.0:1788845971.619119:0:13726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138271a66 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.619127:0:13726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138271a66 expref: 23 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.619145:0:13726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384896:0@lo:104: 00000100:00100000:3.0:1788845971.619166:0:13726:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788845971.620249:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788845971.620281:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845971.620314:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845971.620323:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845971.620332:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702384512 00000100:00100000:0.0:1788845971.620341:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702384512 00000100:00100000:0.0:1788845971.620402:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702384640 00000100:00100000:0.0:1788845971.620406:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702384640 00000100:00100000:0.0:1788845971.620417:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702384768 00000100:00100000:0.0:1788845971.620419:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702384768 00000100:00100000:0.0:1788845971.620428:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702384896 00000100:00100000:0.0:1788845971.620437:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702384896 00000100:00100000:0.0:1788845971.620453:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788845971.620462:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:13726:x1875740702384512:12345-0@lo:104: 00010000:00010000:0.0:1788845971.620479:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.620591:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788845971.620599:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+6:13726:x1875740702384512:12345-0@lo:104: Request processed in 138us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.620607:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788845971.620651:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788845971.620657:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:13726:x1875740702384640:12345-0@lo:104: 00010000:00010000:0.0:1788845971.620665:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.620698:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788845971.620702:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+5:13726:x1875740702384640:12345-0@lo:104: Request processed in 47us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.620708:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788845971.620721:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845971.620727:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:13726:x1875740702384768:12345-0@lo:104: 00010000:00010000:0.0:1788845971.620734:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.620866:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788845971.620872:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+4:13726:x1875740702384768:12345-0@lo:104: Request processed in 145us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.620878:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788845971.620898:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788845971.620905:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:13726:x1875740702384896:12345-0@lo:104: 00010000:00010000:0.0:1788845971.620913:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.620944:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788845971.620948:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+3:13726:x1875740702384896:12345-0@lo:104: Request processed in 45us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.620954:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788845971.620975:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788845971.620983:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.620991:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3a00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788845971.620996:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621006:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845971.621014:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845971.621020:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845971.621054:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621060:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845971.621092:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621110:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3a00/0x21b4d56138271a90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a97 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621126:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788845971.621130:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621136:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0da00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788845971.621139:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621146:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845971.621154:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845971.621159:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845971.621172:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621177:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845971.621183:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621190:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0da00/0x21b4d56138271a82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621199:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788845971.621208:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621214:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788845971.621217:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621224:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845971.621229:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845971.621234:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845971.621246:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621252:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845971.621267:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621273:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0d800/0x21b4d56138271a74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a7b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621283:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788845971.621286:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621292:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0cc00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788845971.621295:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621313:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788845971.621319:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788845971.621324:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788845971.621339:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621347:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788845971.621353:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621360:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0cc00/0x21b4d56138271a66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138271a6d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621387:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845971.621389:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845971.621391:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845971.621399:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845971.621405:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845971.621421:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702385152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845971.621467:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845971.621507:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788845971.621513:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702385024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845971.621561:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845971.621585:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702385408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845971.621616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845971.621632:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845971.621637:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702385280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845971.621654:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845971.621673:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702385152 00000100:00100000:0.0:1788845971.621679:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702385152 00010000:00010000:0.0:1788845971.621704:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a82 expref: 24 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845971.621721:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702385024 00000100:00100000:0.0:1788845971.621724:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702385024 00010000:00010000:0.0:1788845971.621733:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a90 expref: 25 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845971.621754:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702385408 00000100:00100000:0.0:1788845971.621757:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702385408 00010000:00010000:0.0:1788845971.621767:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a66 expref: 26 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845971.621777:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702385280 00000100:00100000:0.0:1788845971.621779:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702385280 00010000:00010000:0.0:1788845971.621788:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a74 expref: 27 pid: 6509 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845971.621799:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845971.621805:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+27:3643:x1875740702385152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845971.621817:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845971.621822:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a82 expref: 27 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621842:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271a82 expref: 27 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621862:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845971.621890:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+27:3643:x1875740702385152:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.621897:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788845971.621910:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788845971.621916:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+26:3643:x1875740702385024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845971.621922:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845971.621927:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a90 expref: 26 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621935:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271a90 expref: 26 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.621944:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845971.621961:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+26:3643:x1875740702385024:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.621967:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788845971.621977:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788845971.621982:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+25:3641:x1875740702385408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845971.621988:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845971.621992:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a66 expref: 25 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.622000:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271a66 expref: 25 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.622016:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845971.622043:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+25:3641:x1875740702385408:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.622048:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788845971.622060:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788845971.622065:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702385280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788845971.622072:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845971.622076:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138271a74 expref: 24 pid: 6509 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.622084:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138271a74 expref: 24 pid: 6509 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.622093:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788845971.622110:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702385280:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.622116:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788845971.622152:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702385280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845971.622160:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702385408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845971.622185:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702385024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788845971.622192:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702385152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788845971.625237:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0dc00/0x21b4d56138271a97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271a90 expref: 23 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.625264:0:13726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384512:0@lo:104: 00010000:00010000:3.0:1788845971.625279:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42da00/0x21b4d56138271a89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271a82 expref: 22 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.625289:0:13726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384640:0@lo:104: 00010000:00010000:3.0:1788845971.625300:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e3400/0x21b4d56138271a7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271a74 expref: 21 pid: 6509 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.625308:0:13726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384768:0@lo:104: 00010000:00010000:3.0:1788845971.625319:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c600/0x21b4d56138271a6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138271a66 expref: 20 pid: 6511 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.625328:0:13726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384896:0@lo:104: 00000004:00080000:1.0:1788845971.628456:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788845971.628497:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:1.0:1788845971.628508:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788845971.628898:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845971.628898:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702385536:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788845971.628923:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.628933:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.628941:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788845971.628970:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845971.628986:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788845971.628996:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629033:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff90e342864200) 00010000:00010000:3.0:1788845971.629037:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845971.629043:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629051:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138271b31 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629080:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629086:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629092:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629097:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788845971.629100:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629105:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629114:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff90e45a2dc700) 00010000:00010000:3.0:1788845971.629116:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845971.629126:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629132:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d56138271b46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629155:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629162:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629169:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629175:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788845971.629179:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629187:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629201:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x880ebab1 (ffff90e342864200) 00000100:00100000:2.0:1788845971.629203:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702385536 00010000:00010000:3.0:1788845971.629205:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845971.629211:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845971.629215:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702385536 00010000:00010000:3.0:1788845971.629219:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d56138271baf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x880ebab1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629246:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629262:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629269:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629274:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788845971.629277:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629283:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629292:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90e3424a3400) 00010000:00010000:3.0:1788845971.629295:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788845971.629298:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629304:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271bcb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845971.629420:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788845971.629433:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702385536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788845971.629461:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788845971.629494:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f9f8e, atime: 0x6a9f9f8e, ctime: 0x6a9f9f8e, blocks: 0x0 00010000:00010000:2.0:1788845971.629550:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.629567:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1788845971.629571:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788845971.629577:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.629608:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.629619:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.629627:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.629652:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788845971.629783:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788845971.629793:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.629806:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788845971.629812:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845971.629823:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702385536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 391us (847us total) trans 4294967301 rc 0/0 00010000:00010000:3.0:1788845971.629855:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.630018:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.630027:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138271be0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.630053:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845971.630056:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845971.630058:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845971.630324:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1788845971.630430:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e46f3ef800/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788845971.630436:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702385536:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788845971.632409:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845971.632607:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683428864 00000100:00100000:0.0:1788845971.632625:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683428864 00000100:00100000:3.0:1788845971.632660:0:13726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384256:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788845971.632680:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 13 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845971.632740:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:0.0:1788845971.632749:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683428864:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788845971.632763:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788845971.632769:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 13 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.632780:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 13 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.632798:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e3200/0x21b4d56138271aa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ab expref: 13 pid: 6511 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845971.632814:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788845971.632977:0:13726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13726:1875740702384384:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788845971.633025:0:13726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788845971.639075:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:2398:x1875740683428864:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 6315us (6668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.639091:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:2.0:1788845971.642394:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845971.642608:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683428992 00000100:00100000:3.0:1788845971.642622:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683428992 00010000:00010000:3.0:1788845971.642746:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845971.642797:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1788845971.642809:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:2398:x1875740683428992:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788845971.642827:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788845971.642854:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.642869:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.645511:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d600/0x21b4d56138271a9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544a4 expref: 12 pid: 6508 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.645654:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.645664:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.645831:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.645871:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.645879:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.645887:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.645893:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788845971.645898:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.645906:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.645931:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845971.645942:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788845971.646009:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:2398:x1875740683428992:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 3200us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845971.646020:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00010000:00010000:3.0:1788845971.646074:0:13726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.646086:0:13726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845971.646093:0:13726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065600/0x21b4d56138271bd9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845971.827489:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845971.827664:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683429248 00000100:00100000:2.0:1788845971.827673:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683429248 00000100:00100000:2.0:1788845971.827744:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:2.0:1788845971.827756:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683429248:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845971.827827:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683429248:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845971.827839:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00080000:0.0:1788845971.827972:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788845971.828080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845971.828099:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845971.828128:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845971.828153:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845971.828173:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683429376 00000100:00100000:1.0:1788845971.828177:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683429376 00000100:00100000:1.0:1788845971.828210:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:1.0:1788845971.828218:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683429376:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845971.828252:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343937b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683429376:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 35us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845971.828259:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:1.0:1788845971.828275:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683429504 00000100:00100000:1.0:1788845971.828279:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683429504 00000100:00100000:1.0:1788845971.828298:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683429120 00000100:00100000:1.0:1788845971.828301:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683429120 00000100:00100000:1.0:1788845971.828316:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683429632 00000100:00100000:1.0:1788845971.828326:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683429632 00000100:00100000:1.0:1788845971.828343:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:1.0:1788845971.828349:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683429504:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845971.828385:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683429504:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845971.828392:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:1.0:1788845971.828404:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:1.0:1788845971.828410:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683429120:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845971.828497:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:0.0:1788845971.828506:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683429632:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845971.828555:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683429632:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845971.828561:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:1.0:1788845971.828637:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683429120:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 226us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845971.828643:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00080000:1.0:1788845971.828729:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788845971.828733:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845971.828735:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788845972.284492:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845972.284569:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788845972.284590:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702385664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788845972.284655:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845972.284868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702385664 00000100:00100000:1.0:1788845972.284876:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702385664 00000100:00100000:1.0:1788845972.284913:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788845972.284922:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702385664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788845972.284953:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788845972.285008:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702385664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845972.285015:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788845972.285091:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702385664:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1788845972.345504:0:13775:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecfbdff30 20000000:00000080:3.0:1788845972.345554:0:13775:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e47b559400 uarg=0000000000000000 20000000:01000000:3.0:1788845972.345597:0:13775:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788845972.345605:0:13775:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788845972.345618:0:13775:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788845972.346169:0:13776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788845972.346309:0:13775:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788845972.346418:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788845972.346448:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788845972.346464:0:13775:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788845972.346476:0:13775:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788845972.346497:0:13775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346513:0:13775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346722:0:13775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346729:0:13775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346735:0:13775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346741:0:13775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346747:0:13775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788845972.346751:0:13775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346770:0:13775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346784:0:13775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346792:0:13775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845972.346798:0:13775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d600/0x21b4d56138271be7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.306106:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845973.423734:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845973.423929:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683429760 00000100:00100000:0.0:1788845973.423952:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683429760 00000100:00100000:0.0:1788845973.424009:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 337 00000100:00100000:0.0:1788845973.424020:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:6169:x1875740683429760:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845973.424035:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845973.424051:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441357000/0x21b4d56138271bee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544f8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.424077:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441357000/0x21b4d56138271bee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544f8 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.424088:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441357000/0x21b4d56138271bee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544f8 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.424098:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357000, rc 0) 00000100:00100000:0.0:1788845973.424155:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683429760:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 136us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.424162:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 337 00000100:00100000:1.0:1788845973.430618:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845973.430774:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683429888 00000100:00100000:0.0:1788845973.430784:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683429888 00000100:00100000:0.0:1788845973.430843:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 338 00000100:00100000:0.0:1788845973.430853:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683429888:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788845973.431002:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683429888:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 150us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.431011:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 338 00000100:00100000:1.0:1788845973.436353:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845973.436413:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683430016 00000100:00100000:2.0:1788845973.436424:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683430016 00000100:00100000:2.0:1788845973.436482:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 339 00000100:00100000:2.0:1788845973.436492:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683430016:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.436663:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683430016:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 171us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.436671:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 339 00000100:00100000:2.0:1788845973.452063:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845973.452574:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683430144 00000100:00100000:3.0:1788845973.452597:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683430144 00000100:00100000:3.0:1788845973.452656:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 340 00000100:00100000:3.0:1788845973.452667:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:10772:x1875740683430144:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845973.452820:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b591850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:10772:x1875740683430144:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 154us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.452829:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 340 00000100:00100000:1.0:1788845973.463296:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845973.463451:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683430272 00000100:00100000:0.0:1788845973.463462:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683430272 00000100:00100000:0.0:1788845973.463516:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 341 00000100:00100000:0.0:1788845973.463556:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:10772:x1875740683430272:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788845973.463726:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:10772:x1875740683430272:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 173us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.463735:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 341 00000100:00100000:1.0:1788845973.468729:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845973.468976:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683430400 00000100:00100000:2.0:1788845973.468986:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683430400 00000100:00100000:2.0:1788845973.469043:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 342 00000100:00100000:2.0:1788845973.469053:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:6169:x1875740683430400:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845973.469068:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845973.469084:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c200/0x21b4d56138271bf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217544ff expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.469118:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c200/0x21b4d56138271bf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ff expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.469130:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c200/0x21b4d56138271bf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ff expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.469140:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c200, rc 0) 00000100:00100000:2.0:1788845973.469196:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683430400:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 144us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.469203:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 342 00000100:00100000:2.0:1788845973.471139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845973.471218:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683430528 00000100:00100000:3.0:1788845973.471227:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683430528 00000100:00100000:3.0:1788845973.471276:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 343 00000100:00100000:3.0:1788845973.471285:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683430528:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.471429:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683430528:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 145us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.471437:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 343 00000100:00100000:1.0:1788845973.473471:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845973.473558:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683430656 00000100:00100000:0.0:1788845973.473567:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683430656 00000100:00100000:0.0:1788845973.473617:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 344 00000100:00100000:0.0:1788845973.473627:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683430656:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845973.473759:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:6169:x1875740683430656:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 133us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.473768:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 344 00000100:00100000:1.0:1788845973.477638:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845973.477723:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683430784 00000100:00100000:2.0:1788845973.477732:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683430784 00000100:00100000:2.0:1788845973.477787:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 345 00000100:00100000:2.0:1788845973.477805:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:10774:x1875740683430784:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788845973.477957:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:10774:x1875740683430784:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 153us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.477965:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 345 00000100:00100000:2.0:1788845973.483669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845973.483753:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683430912 00000100:00100000:3.0:1788845973.483764:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683430912 00000100:00100000:3.0:1788845973.483826:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 346 00000100:00100000:3.0:1788845973.483836:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:10774:x1875740683430912:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788845973.483977:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:10774:x1875740683430912:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 142us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.483986:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 346 10000000:01000000:1.0:1788845973.561635:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845973.561653:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e342932800 from 7 10000000:01000000:1.0:1788845973.561658:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845973.561712:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.561723:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.561735:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845973.561759:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702385792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845973.561834:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845973.561902:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788845973.562300:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702385792 00000100:00100000:0.0:1788845973.562308:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702385792 00000100:00100000:0.0:1788845973.562375:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788845973.562386:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:6513:x1875740702385792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845973.562398:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845973.562421:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441357800/0x21b4d56138271c03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271bfc expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.562448:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441357800/0x21b4d56138271c03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271bfc expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.562458:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441357800/0x21b4d56138271c03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271bfc expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.562467:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357800, rc 0) 00000100:00100000:0.0:1788845973.562545:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702385792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.562569:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788845973.562793:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702385792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788845973.562808:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.562817:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845973.562882:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702385920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845973.562909:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845973.562933:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.563188:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702385920 00000100:00100000:2.0:1788845973.563193:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702385920 00000100:00100000:2.0:1788845973.563233:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788845973.563240:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702385920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.564100:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702385920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 859us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.564122:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788845973.565013:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702385920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845973.565123:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702386048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845973.565184:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845973.565273:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845973.565313:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702386048 00000100:00100000:3.0:1788845973.565320:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702386048 00000100:00100000:3.0:1788845973.565544:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788845973.565553:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702386048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.566254:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702386048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 699us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.566270:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788845973.566918:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702386048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845973.567570:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13789:1875740702386176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788845973.567627:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845973.567811:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.569131:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702386176 00000100:00100000:2.0:1788845973.569143:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702386176 00000100:00100000:2.0:1788845973.569243:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788845973.569253:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:13789:x1875740702386176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845973.569422:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:13789:x1875740702386176:12345-0@lo:502:llog_process_th.0 Request processed in 170us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.569430:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788845973.569548:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13789:1875740702386176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845973.569592:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845973.569602:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845973.569605:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788845973.569611:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e342932800 00000020:00000080:0.0:1788845973.569614:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788845973.570450:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845973.570456:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845973.570458:0:13789:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788845973.570460:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788845973.570464:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845973.570465:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788845973.570469:0:13789:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e342932800 00000020:00000080:0.0:1788845973.570471:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788845973.570569:0:13789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13789:1875740702386304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845973.570627:0:13789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845973.571578:0:13789:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788845973.577930:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702386304 00000100:00100000:3.0:1788845973.577945:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702386304 00000100:00100000:3.0:1788845973.578017:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788845973.578028:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:13789:x1875740702386304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845973.578747:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:13789:x1875740702386304:12345-0@lo:502:llog_process_th.0 Request processed in 719us (8116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.578757:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788845973.579250:0:13789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13789:1875740702386304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845973.579377:0:13789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845973.579386:0:13789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845973.579389:0:13789:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788845973.579393:0:13789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788845973.579761:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788845973.579785:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788845973.580007:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.580019:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788845973.580030:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788845973.580033:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451767800 from 7 10000000:01000000:1.0:1788845973.580036:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788845973.580068:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.580076:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788845973.580086:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788845973.580106:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343936d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702386432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788845973.580157:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845973.580196:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cf180 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.580314:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702386432 00000100:00100000:2.0:1788845973.580321:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702386432 00000100:00100000:2.0:1788845973.580377:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788845973.580386:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:6513:x1875740702386432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845973.580397:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845973.580409:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c600/0x21b4d56138271c11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271c0a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.580436:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c600/0x21b4d56138271c11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271c0a expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.580447:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c600/0x21b4d56138271c11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271c0a expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.580463:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c600, rc 0) 00000100:00100000:2.0:1788845973.580514:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702386432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.580542:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788845973.580591:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343936d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702386432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845973.580607:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.580618:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845973.580679:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702386560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.580710:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.580741:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427fe600 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.581278:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702386560 00000100:00100000:2.0:1788845973.581284:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702386560 00000100:00100000:2.0:1788845973.581321:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788845973.581330:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702386560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.581465:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702386560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.581482:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788845973.581639:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702386560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788845973.581681:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702386688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788845973.581719:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845973.581742:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cf480 going to sleep for 11 seconds 00000100:00100000:3.0:1788845973.581909:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702386688 00000100:00100000:3.0:1788845973.581914:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702386688 00000100:00100000:3.0:1788845973.581938:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788845973.581944:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702386688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.582019:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702386688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.582026:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788845973.582067:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343934e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702386688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.582226:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13792:1875740702386816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845973.582258:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.582274:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702386816 00000100:00100000:3.0:1788845973.582277:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702386816 00000100:00100000:3.0:1788845973.582294:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788845973.582299:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:13792:x1875740702386816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845973.582371:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:13792:x1875740702386816:12345-0@lo:502:llog_process_th.0 Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.582378:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788845973.582404:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845973.582415:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13792:1875740702386816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845973.582435:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845973.582445:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845973.582447:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788845973.582453:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e451767800 00000020:00000080:3.0:1788845973.582455:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788845973.582516:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845973.582541:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845973.582543:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788845973.582546:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845973.582548:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845973.582549:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788845973.582553:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e451767800 00000020:00000080:3.0:1788845973.582554:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845973.582591:0:13792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13792:1875740702386944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845973.582623:0:13792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.582648:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702386944 00000100:00100000:3.0:1788845973.582652:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702386944 00000100:00100000:3.0:1788845973.582670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788845973.582676:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:13792:x1875740702386944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845973.582736:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:13792:x1875740702386944:12345-0@lo:502:llog_process_th.0 Request processed in 60us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.582742:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788845973.582771:0:13792:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845973.582781:0:13792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13792:1875740702386944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845973.582798:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845973.582803:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845973.582804:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788845973.582807:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788845973.582864:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788845973.582883:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788845973.582891:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.582901:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788845973.582910:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788845973.582912:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47518c000 from 7 10000000:01000000:3.0:1788845973.582916:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788845973.582939:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.582946:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.582965:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788845973.582976:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.583005:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.583018:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788845973.583033:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702387072 00000100:00100000:3.0:1788845973.583036:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702387072 00000100:00100000:3.0:1788845973.583068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788845973.583074:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:6513:x1875740702387072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788845973.583082:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788845973.583093:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064c00/0x21b4d56138271c1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271c18 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.583111:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064c00/0x21b4d56138271c1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271c18 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.583119:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064c00/0x21b4d56138271c1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271c18 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788845973.583127:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064c00, rc 0) 00000100:00100000:3.0:1788845973.583159:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702387072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.583164:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788845973.583200:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845973.583215:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.583227:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845973.583359:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.583397:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845973.583420:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.583433:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702387200 00000100:00100000:2.0:1788845973.583436:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702387200 00000100:00100000:2.0:1788845973.583461:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788845973.583468:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702387200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.584092:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.584124:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788845973.584169:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845973.584202:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702387200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.584205:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.584216:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788845973.584234:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702387328 00000100:00100000:0.0:1788845973.584240:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702387328 00000100:00100000:0.0:1788845973.584272:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788845973.584279:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702387328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845973.584360:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702387328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.584376:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788845973.584396:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788845973.584725:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13793:1875740702387456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788845973.584765:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845973.585132:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475315900 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.585164:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702387456 00000100:00100000:2.0:1788845973.585170:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702387456 00000100:00100000:2.0:1788845973.585229:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788845973.585246:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:13793:x1875740702387456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845973.585346:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:13793:x1875740702387456:12345-0@lo:502:llog_process_th.0 Request processed in 108us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.585354:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788845973.585505:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13793:1875740702387456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788845973.585603:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845973.585614:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845973.585616:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788845973.585623:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e47518c000 00000020:00000080:2.0:1788845973.585626:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788845973.585720:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788845973.585725:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845973.585727:0:13793:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788845973.585730:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788845973.585734:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788845973.585735:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788845973.585739:0:13793:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e47518c000 00000020:00000080:2.0:1788845973.585741:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788845973.586516:0:13793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13793:1875740702387584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845973.586592:0:13793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845973.586634:0:13793:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788845973.587086:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702387584 00000100:00100000:3.0:1788845973.587093:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702387584 00000100:00100000:3.0:1788845973.587194:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788845973.587205:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:13793:x1875740702387584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845973.587321:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:13793:x1875740702387584:12345-0@lo:502:llog_process_th.0 Request processed in 118us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845973.587329:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788845973.587411:0:13793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13793:1875740702387584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788845973.587438:0:13793:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788845973.587445:0:13793:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788845973.587446:0:13793:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788845973.587450:0:13793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788845973.590304:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788845973.590339:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845973.590350:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.590371:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788845973.590384:0:6513:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788845973.590386:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e451417000 from 7 10000000:01000000:2.0:1788845973.590389:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788845973.590426:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.590434:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.590444:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845973.590468:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.590562:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845973.590614:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788845973.590835:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702387712 00000100:00100000:0.0:1788845973.590843:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702387712 00000100:00100000:0.0:1788845973.590889:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788845973.590899:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:6513:x1875740702387712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788845973.590910:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845973.590923:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441357c00/0x21b4d56138271c2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138271c26 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.590945:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441357c00/0x21b4d56138271c2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138271c26 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.590955:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441357c00/0x21b4d56138271c2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138271c26 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845973.590963:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357c00, rc 0) 00000100:00100000:0.0:1788845973.591001:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702387712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845973.591008:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788845973.591262:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788845973.591277:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.591286:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788845973.591354:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.591413:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845973.591435:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.591448:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702387840 00000100:00100000:2.0:1788845973.591451:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702387840 00000100:00100000:2.0:1788845973.591634:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788845973.591643:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702387840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.591745:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702387840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.591752:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788845973.591783:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.591809:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.592615:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845973.592641:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.592657:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702387968 00000100:00100000:2.0:1788845973.592662:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702387968 00000100:00100000:2.0:1788845973.592685:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788845973.592691:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702387968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.592771:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:6513:x1875740702387968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.592778:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788845973.594649:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:6513:1875740702387968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788845973.595664:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13795:1875740702388096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845973.595745:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845973.595784:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702388096 00000100:00100000:2.0:1788845973.595791:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702388096 00000100:00100000:3.0:1788845973.595800:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.597610:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788845973.597626:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:13795:x1875740702388096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845973.597770:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:13795:x1875740702388096:12345-0@lo:502:llog_process_th.0 Request processed in 149us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.597778:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000040:00080000:1.0:1788845973.597980:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788845973.598247:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13795:1875740702388096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845973.598280:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845973.598289:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845973.598291:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788845973.598298:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e451417000 00000020:00000080:3.0:1788845973.598302:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788845973.598378:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845973.598382:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845973.598384:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788845973.598387:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788845973.598389:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845973.598391:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788845973.598394:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e451417000 00000020:00000080:3.0:1788845973.598396:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788845973.598442:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13795:1875740702388224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788845973.598488:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845973.598545:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788845973.598594:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702388224 00000100:00100000:2.0:1788845973.598601:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702388224 00000100:00100000:2.0:1788845973.598643:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788845973.598652:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:13795:x1875740702388224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788845973.598742:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:13795:x1875740702388224:12345-0@lo:502:llog_process_th.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845973.598750:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788845973.598882:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:13795:1875740702388224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788845973.598920:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788845973.598924:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788845973.598926:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788845973.598930:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788845973.599929:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788845973.599957:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788845973.599967:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845973.599979:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788845973.609609:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788845974.329767:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788845974.651383:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788845974.653548:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788845974.841832:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702388480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788845974.841900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845974.841980:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788845974.841987:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702388352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845974.842025:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845974.844035:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702388480 00000100:00100000:1.0:1788845974.844049:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702388480 00000100:00100000:1.0:1788845974.844110:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702388352 00000100:00100000:1.0:1788845974.844113:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702388352 00000100:00100000:1.0:1788845974.844132:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788845974.844142:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702388480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845974.844171:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845974.844237:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702388480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845974.844244:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788845974.844259:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788845974.844265:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702388352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845974.844274:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845974.844297:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702388352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845974.844303:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788845974.844344:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1880 x1875740702388352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845974.844374:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702388352:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788845974.844388:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343935880 x1875740702388480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845974.844418:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702388480:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788845974.844654:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788845975.354631:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702388736:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.354675:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702388992:0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.354702:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.354733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845975.354770:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702389248:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.354776:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702389504:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.354808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.354828:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702390016:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.354849:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.354871:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788845975.354878:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702388864:0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.354886:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.354917:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.354937:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702389376:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.354959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.354974:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702389888:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.354995:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845975.355030:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702389760:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.355033:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702388864 00000100:00100000:3.0:1788845975.355041:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702388864 00000100:00100000:1.0:1788845975.355060:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845975.355080:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702390272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788845975.355094:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788845975.355103:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.355108:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.355121:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788845975.355129:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702388608:0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.355168:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.355177:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702388864:12345-0@lo:400:kworker.0 Request processed in 73us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.355186:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788845975.355195:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.355214:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702390272 00000100:00100000:1.0:1788845975.355220:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.355221:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702390272 00000100:00100000:1.0:1788845975.355233:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702389632:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.355240:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702389120 00000100:00100000:3.0:1788845975.355244:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702389120 00000100:00100000:3.0:1788845975.355258:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788845975.355264:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702390272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788845975.355285:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788845975.355325:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702390272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845975.355333:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.355337:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788845975.355366:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788845975.355373:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702390144:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.355377:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702389120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.355414:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.355421:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702389120:12345-0@lo:400:kworker.0 Request processed in 48us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.355428:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788845975.355452:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702388736 00000100:00100000:3.0:1788845975.355456:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702388736 00000100:00100000:1.0:1788845975.355460:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702390272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788845975.355479:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702388992 00000100:00100000:3.0:1788845975.355483:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702388992 00000100:00100000:1.0:1788845975.355487:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.355500:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702389248 00000100:00100000:3.0:1788845975.355504:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702389248 00000100:00100000:1.0:1788845975.355515:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702389376 00000100:00100000:1.0:1788845975.355539:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702389376 00000100:00100000:3.0:1788845975.355551:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702389888 00000100:00100000:3.0:1788845975.355556:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702389888 00000100:00100000:3.0:1788845975.355567:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702389760 00000100:00100000:3.0:1788845975.355570:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702389760 00000100:00100000:3.0:1788845975.355585:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788845975.355590:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702388736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.355637:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788845975.355648:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702388992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.355649:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702388736:12345-0@lo:400:kworker.0 Request processed in 54us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.355671:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788845975.355689:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788845975.355693:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702388992:12345-0@lo:400:kworker.0 Request processed in 47us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.355700:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702389248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.355702:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788845975.355723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788845975.355731:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702389888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.355746:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702389248:12345-0@lo:400:kworker.0 Request processed in 48us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.355754:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788845975.355767:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702389888:12345-0@lo:400:kworker.0 Request processed in 37us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.355774:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788845975.355790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788845975.355804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788845975.355811:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702389376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.355841:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702389376:12345-0@lo:400:kworker.0 Request processed in 30us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845975.355845:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702389504 00000100:00100000:1.0:1788845975.355850:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788845975.355852:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702389504 00000100:00100000:1.0:1788845975.355875:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702390016 00000100:00100000:1.0:1788845975.355880:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702390016 00000100:00100000:0.0:1788845975.355883:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702389632 00000100:00100000:0.0:1788845975.355888:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702389632 00000100:00100000:1.0:1788845975.355904:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702390144 00000100:00100000:1.0:1788845975.355909:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702390144 00000100:00100000:0.0:1788845975.355913:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788845975.355921:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702389504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845975.355953:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702389504:12345-0@lo:400:kworker.0 Request processed in 33us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845975.355960:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788845975.355971:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788845975.355976:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702390016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845975.356002:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702390016:12345-0@lo:400:kworker.0 Request processed in 27us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845975.356008:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788845975.356019:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788845975.356024:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702389632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.356049:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788845975.356060:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702389632:12345-0@lo:400:kworker.0 Request processed in 33us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845975.356061:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702390144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845975.356075:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788845975.356094:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788845975.356100:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845975.356103:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845975.356108:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702390144:12345-0@lo:400:kworker.0 Request processed in 50us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845975.356116:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788845975.356147:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b3100 x1875740702389632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845975.356159:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702389632:0@lo:400:kworker.0 00010000:00010000:1.0:1788845975.356165:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845975.356184:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702390144:0@lo:400:kworker.0 00000100:00100000:0.0:1788845975.356199:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702388736:0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.356218:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702388864:0@lo:400:kworker.0 00000100:00100000:0.0:1788845975.356219:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702389248:0@lo:400:kworker.0 00010000:00080000:1.0:1788845975.356316:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b2d80 x1875740702389376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845975.356326:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702389376:0@lo:400:kworker.0 00010000:00080000:1.0:1788845975.356340:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b2a00 x1875740702389888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845975.356346:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702388608 00000100:00100000:1.0:1788845975.356359:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702389888:0@lo:400:kworker.0 00000100:00100000:2.0:1788845975.356364:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702388608 00000100:00100000:1.0:1788845975.356374:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702388992:0@lo:400:kworker.0 00010000:00080000:1.0:1788845975.356388:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1180 x1875740702389504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845975.356397:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702389504:0@lo:400:kworker.0 00000100:00100000:1.0:1788845975.356411:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702390016:0@lo:400:kworker.0 00000100:00100000:2.0:1788845975.356412:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788845975.356425:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702388608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845975.356476:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702388608:12345-0@lo:400:kworker.0 Request processed in 55us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845975.356483:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788845975.356494:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702388608:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.357701:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702389760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.357772:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702389760:12345-0@lo:400:kworker.0 Request processed in 1989us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845975.357780:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788845975.357825:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702389760:0@lo:400:kworker.0 00000100:00100000:3.0:1788845975.866103:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788845975.866128:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702390528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845975.866197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845975.866340:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702390400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845975.866367:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702390528 00000100:00100000:1.0:1788845975.866376:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702390528 00000100:00100000:3.0:1788845975.866381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845975.866424:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702390400 00000100:00100000:1.0:1788845975.866428:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702390400 00000100:00100000:3.0:1788845975.866444:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788845975.866504:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702390528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788845975.866551:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845975.866608:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702390528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845975.866671:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4412ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702390528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788845975.868313:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788845975.868333:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702390400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845975.868365:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845975.868487:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702390400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845975.868512:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788845975.868616:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702390400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845975.875488:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:0.0:1788845976.377734:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788845976.893867:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1788845976.953101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845976.953155:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845976.953193:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845976.953226:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845976.953251:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845976.953275:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845976.953306:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683431296 00000100:00100000:1.0:1788845976.953315:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683431296 00000100:00100000:1.0:1788845976.953385:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683431552 00000100:00100000:1.0:1788845976.953388:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683431552 00000100:00100000:1.0:1788845976.953402:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683431168 00000100:00100000:1.0:1788845976.953404:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683431168 00000100:00100000:1.0:1788845976.953414:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683431680 00000100:00100000:1.0:1788845976.953417:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683431680 00000100:00100000:0.0:1788845976.953564:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:0.0:1788845976.953577:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683431296:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845976.953645:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683431296:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 72us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845976.953653:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:0.0:1788845976.953672:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:0.0:1788845976.953678:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683431552:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845976.953705:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683431552:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 29us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845976.953710:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:0.0:1788845976.953722:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:0.0:1788845976.953727:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683431168:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845976.953756:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683431168:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 18us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845976.953762:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00080000:0.0:1788845976.953816:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788845976.953820:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788845976.953828:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683431424 00000100:00100000:0.0:1788845976.953844:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683431424 00000100:00100000:0.0:1788845976.953876:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:0.0:1788845976.953883:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683431424:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845976.953908:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683431424:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845976.953915:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00080000:0.0:1788845976.953934:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788845976.954088:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 215 00000100:00100000:1.0:1788845976.954096:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683431680:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845976.954123:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683431680:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845976.954129:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 215 00000100:00080000:0.0:1788845976.954319:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788845976.955059:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683431040 00000100:00100000:3.0:1788845976.955067:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683431040 00000100:00100000:3.0:1788845976.955120:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 368 00000100:00100000:3.0:1788845976.955139:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683431040:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845976.955191:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683431040:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 55us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845976.955197:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 368 00010000:00010000:3.0:1788845977.402662:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788845977.402968:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788845977.402995:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702390656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788845977.403084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845977.404359:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702390656 00000100:00100000:1.0:1788845977.404375:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702390656 00000100:00100000:1.0:1788845977.404518:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788845977.404557:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702390656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788845977.404605:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788845977.404692:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702390656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845977.404720:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788845977.404750:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702390656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788845978.425799:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845979.450676:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845979.961770:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702390784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845979.961861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845979.961967:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702390784 00000100:00100000:1.0:1788845979.961976:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702390784 00000100:00100000:1.0:1788845979.962057:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788845979.962068:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702390784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845979.962099:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845979.962143:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702390784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845979.962150:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1788845979.962194:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4412ad880 x1875740702390784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845979.962212:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4412ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702390784:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788845979.962483:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845979.962698:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788845979.962710:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702390912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788845979.962745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845979.962954:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702390912 00000100:00100000:3.0:1788845979.962960:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702390912 00000100:00100000:3.0:1788845979.963012:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788845979.963019:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702390912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845979.963034:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845979.963079:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702390912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845979.963086:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1788845979.963155:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f4ef480 x1875740702390912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788845995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845979.963169:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702390912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788845979.963213:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788845980.473787:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845980.475146:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702391040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845980.475219:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702391168:0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.475233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845980.475357:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702391040 00000100:00100000:3.0:1788845980.475369:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702391040 00000100:00100000:3.0:1788845980.475424:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788845980.475439:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702391040:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845980.475451:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702391296:0@lo:400:kworker.0 00000004:00000024:3.0:1788845980.475481:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788845980.480380:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702391552:0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.480447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845980.480627:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702392064:0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.480658:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845980.480683:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702392576:0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.480707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845980.481286:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845980.481341:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702391680:0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.481375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845980.481400:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702392192:0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.481422:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845980.481442:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702392704:0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.481468:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845980.481508:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702391424:0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.481769:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845980.481786:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702391936:0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.481817:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845980.481841:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702391552 00000100:00100000:1.0:1788845980.481842:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702392448:0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.481856:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702391552 00000100:00100000:1.0:1788845980.481881:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845980.481904:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702391936 00000100:00100000:0.0:1788845980.481909:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702391936 00000100:00100000:1.0:1788845980.481935:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702391680 00000100:00100000:1.0:1788845980.481941:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702391680 00000100:00100000:0.0:1788845980.481941:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702392448 00000100:00100000:0.0:1788845980.481947:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702392448 00000100:00100000:1.0:1788845980.481967:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702391424 00000100:00100000:1.0:1788845980.481972:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702391424 00000100:00100000:0.0:1788845980.481977:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788845980.481988:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702391552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.481996:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788845980.482006:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702391680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.482051:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702391552:12345-0@lo:400:kworker.0 Request processed in 65us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845980.482059:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788845980.482064:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702391680:12345-0@lo:400:kworker.0 Request processed in 58us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845980.482072:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788845980.482083:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788845980.482095:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788845980.482095:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702391936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.482106:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875740702391424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.482348:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3643:x1875740702391424:12345-0@lo:400:kworker.0 Request processed in 244us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845980.482356:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788845980.482378:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702392064 00000100:00100000:1.0:1788845980.482383:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702392064 00000100:00100000:1.0:1788845980.482398:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702392192 00000100:00100000:1.0:1788845980.482400:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702392192 00000100:00100000:1.0:1788845980.482408:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702392704 00000100:00100000:1.0:1788845980.482411:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702392704 00000100:00100000:1.0:1788845980.482421:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702392576 00000100:00100000:1.0:1788845980.482423:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702392576 00000100:00100000:1.0:1788845980.482435:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788845980.482448:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702392064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.482482:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702392064:12345-0@lo:400:kworker.0 Request processed in 34us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845980.482488:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788845980.482500:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788845980.482506:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702392192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845980.482606:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702391040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7171us (7373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845980.482615:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788845980.482674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788845980.482690:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702392448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845980.482723:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702392448:12345-0@lo:400:kworker.0 Request processed in 36us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845980.482730:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788845980.482755:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788845980.482764:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702392704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845980.482772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845980.482805:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702391296 00000100:00100000:2.0:1788845980.482809:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702391296 00000100:00100000:2.0:1788845980.482830:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788845980.482836:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702391296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845980.482866:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702391296:12345-0@lo:400:kworker.0 Request processed in 30us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845980.482872:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788845980.483161:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702391296:0@lo:400:kworker.0 00000100:00100000:2.0:1788845980.483173:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702391808:0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.483196:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702391936:12345-0@lo:400:kworker.0 Request processed in 1104us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845980.483207:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788845980.483283:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702392192:12345-0@lo:400:kworker.0 Request processed in 48us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845980.483293:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788845980.483302:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702392704:12345-0@lo:400:kworker.0 Request processed in 538us (1830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845980.483309:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788845980.483326:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788845980.483336:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702392576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845980.483350:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702391168 00000100:00100000:3.0:1788845980.483356:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702391168 00000100:00100000:3.0:1788845980.483393:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788845980.483394:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475f71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702392576:12345-0@lo:400:kworker.0 Request processed in 58us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845980.483403:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845980.483406:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788845980.483444:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702391168:12345-0@lo:400:kworker.0 Request processed in 43us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845980.483452:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788845980.483503:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702391552:0@lo:400:kworker.0 00010000:00080000:0.0:1788845980.483517:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad6300 x1875740702392064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845980.483541:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702392064:0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.483553:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702392576:0@lo:400:kworker.0 00000100:00080000:3.0:1788845980.483557:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845980.483561:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788845980.483568:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702391040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788845980.483616:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702391680:0@lo:400:kworker.0 00010000:00080000:3.0:1788845980.483627:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad5c00 x1875740702392192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788845996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845980.483635:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702392192:0@lo:400:kworker.0 00000100:00100000:3.0:1788845980.483645:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788845980.483649:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e46f3ef800, transno 4294967301 00000100:00100000:3.0:1788845980.483660:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702392704:0@lo:400:kworker.0 00000100:00100000:3.0:1788845980.483678:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702391168:0@lo:400:kworker.0 00000100:00100000:0.0:1788845980.483899:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702391424:0@lo:400:kworker.0 00010000:00080000:0.0:1788845980.483906:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343ad5180 x1875740702391936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845980.483912:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702391936:0@lo:400:kworker.0 00010000:00080000:0.0:1788845980.483926:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f508a80 x1875740702392448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788845996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845980.483931:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f508a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702392448:0@lo:400:kworker.0 00000100:00100000:2.0:1788845980.484452:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845980.484502:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f50b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702392320:0@lo:400:kworker.0 00000100:00100000:2.0:1788845980.484552:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845980.484558:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702391808 00000100:00100000:3.0:1788845980.484564:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702391808 00000100:00100000:3.0:1788845980.484596:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702392320 00000100:00100000:3.0:1788845980.484600:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702392320 00000100:00080000:2.0:1788845980.484604:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788845980.484621:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788845980.484634:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702391808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845980.484686:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702391808:12345-0@lo:400:kworker.0 Request processed in 58us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845980.484693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788845980.484706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788845980.484712:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702392320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845980.484714:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702391808:0@lo:400:kworker.0 00000100:00100000:3.0:1788845980.484744:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702392320:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845980.484746:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f50b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702392320:0@lo:400:kworker.0 00000100:00100000:3.0:1788845980.484750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788845980.986558:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702392832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845980.986640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845980.986801:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702392960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788845980.986951:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845980.987182:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702392832 00000100:00100000:3.0:1788845980.987191:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702392832 00000100:00100000:3.0:1788845980.987238:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702392960 00000100:00100000:3.0:1788845980.987242:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702392960 00000100:00100000:3.0:1788845980.987258:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788845980.987267:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702392832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788845980.987294:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845980.987440:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788845980.987449:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702392960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788845980.987460:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845980.987493:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702392960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845980.987501:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788845980.987564:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4412adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702392960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845980.988338:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702392832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1069us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845980.988346:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788845980.988406:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702392832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788845981.497664:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845982.067876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845982.067916:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845982.067951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845982.067984:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845982.068004:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845982.068025:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845982.068103:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683432192 00000100:00100000:0.0:1788845982.068114:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683432192 00000100:00100000:0.0:1788845982.068177:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:0.0:1788845982.068187:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683432192:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845982.068293:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683432192:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 107us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845982.068301:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:0.0:1788845982.068613:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683431936 00000100:00100000:0.0:1788845982.068618:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683431936 00000100:00100000:0.0:1788845982.068662:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683432448 00000100:00100000:0.0:1788845982.068665:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683432448 00000100:00100000:0.0:1788845982.068679:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683432064 00000100:00100000:0.0:1788845982.068681:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683432064 00000100:00100000:0.0:1788845982.068713:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683432320 00000100:00100000:0.0:1788845982.068715:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683432320 00000100:00100000:0.0:1788845982.068737:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:0.0:1788845982.068744:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683431936:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845982.068777:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683431936:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845982.068783:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:0.0:1788845982.068794:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:0.0:1788845982.068800:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683432448:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845982.068822:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683432448:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845982.068828:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:0.0:1788845982.068838:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 224 00000100:00100000:0.0:1788845982.068843:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683432064:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845982.068863:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683432064:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 20us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845982.068869:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 224 00000100:00100000:0.0:1788845982.068879:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 225 00000100:00100000:0.0:1788845982.068885:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683432320:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845982.068902:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683432320:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 17us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845982.068907:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 225 00000100:00100000:3.0:1788845982.069559:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683431808 00000100:00100000:3.0:1788845982.069574:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683431808 00000100:00100000:3.0:1788845982.069606:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 370 00000100:00100000:3.0:1788845982.069613:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683431808:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845982.069656:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683431808:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845982.069663:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 370 00000100:00080000:1.0:1788845982.070146:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788845982.070150:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845982.070153:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788845982.522093:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702393088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788845982.522164:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845982.522268:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702393088 00000100:00100000:3.0:1788845982.522276:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702393088 00000100:00100000:3.0:1788845982.522340:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788845982.522350:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702393088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788845982.522383:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788845982.522787:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702393088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 436us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845982.522796:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788845982.522905:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702393088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788845982.523867:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788845983.546185:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788845984.569688:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788845984.890621:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788845984.891423:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788845985.081795:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702393216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788845985.081861:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845985.083029:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702393216 00000100:00100000:0.0:1788845985.083040:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702393216 00000100:00100000:0.0:1788845985.083107:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788845985.083118:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702393216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788845985.083147:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845985.083372:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702393344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845985.083410:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845985.083451:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702393344 00000100:00100000:3.0:1788845985.083454:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702393344 00000100:00100000:3.0:1788845985.083477:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788845985.083484:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702393344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845985.083495:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845985.083543:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702393344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845985.083549:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1788845985.083588:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f4ee300 x1875740702393344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845985.083633:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702393344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788845985.084089:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788845985.086311:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702393216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3185us (4438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845985.086323:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1788845985.086436:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4412af480 x1875740702393216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845985.086457:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702393216:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788845985.593756:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845985.593898:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845985.593919:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702393472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845985.593999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845985.594167:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702393472 00000100:00100000:3.0:1788845985.594175:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702393472 00000100:00100000:3.0:1788845985.594222:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788845985.594231:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702393472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788845985.594262:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788845985.594328:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702393472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845985.594334:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788845985.594697:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702393984:0@lo:400:kworker.0 00000100:00100000:0.0:1788845985.594725:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845985.594748:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702394496:0@lo:400:kworker.0 00000100:00100000:0.0:1788845985.594772:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845985.594791:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788845985.594797:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702393856:0@lo:400:kworker.0 00000100:00100000:0.0:1788845985.594819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845985.594840:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702394368:0@lo:400:kworker.0 00000100:00100000:0.0:1788845985.594860:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845985.594887:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702393984 00000100:00100000:0.0:1788845985.594891:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702393984 00000100:00100000:0.0:1788845985.594917:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788845985.594923:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702393984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845985.594960:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702393984:12345-0@lo:400:kworker.0 Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845985.594974:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788845985.594993:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702394496 00000100:00100000:0.0:1788845985.594996:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702394496 00000100:00100000:2.0:1788845985.595126:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702393600:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.595162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845985.595186:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702394112:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.595208:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845985.595224:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702394624:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.595247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845985.595264:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788845985.595270:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702393728:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.595301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845985.595312:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702394240:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.595330:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845985.595339:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702394752:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.595355:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845985.595454:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702394624 00000100:00100000:1.0:1788845985.595458:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702394624 00000100:00100000:1.0:1788845985.595484:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702394752 00000100:00100000:1.0:1788845985.595487:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702394752 00000100:00100000:1.0:1788845985.595505:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788845985.595511:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702394624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.595596:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702393600 00000100:00100000:2.0:1788845985.595607:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702393600 00000100:00100000:2.0:1788845985.595638:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788845985.595645:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702393600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845985.595716:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788845985.595726:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702394752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845985.598352:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702393856 00000100:00100000:0.0:1788845985.598368:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702393856 00000100:00100000:0.0:1788845985.598421:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702394368 00000100:00100000:0.0:1788845985.598425:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702394368 00000100:00100000:0.0:1788845985.598441:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702394112 00000100:00100000:0.0:1788845985.598444:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702394112 00000100:00100000:0.0:1788845985.598459:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702393728 00000100:00100000:0.0:1788845985.598462:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702393728 00000100:00100000:0.0:1788845985.598471:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702394240 00000100:00100000:0.0:1788845985.598473:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702394240 00000100:00100000:0.0:1788845985.598491:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788845985.598499:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702394496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845985.604653:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702394624:12345-0@lo:400:kworker.0 Request processed in 9132us (9395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845985.604666:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788845985.604740:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702394624:0@lo:400:kworker.0 00000100:00100000:1.0:1788845985.604787:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702393472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845985.604837:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788845985.604849:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702393856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845985.604900:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702393856:12345-0@lo:400:kworker.0 Request processed in 55us (10079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845985.604906:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788845985.604923:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788845985.604931:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702394368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845985.604962:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702394368:12345-0@lo:400:kworker.0 Request processed in 33us (10100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845985.604968:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788845985.604980:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788845985.604986:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702394112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845985.605020:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702394112:12345-0@lo:400:kworker.0 Request processed in 34us (9811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845985.605664:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450db9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702393600:12345-0@lo:400:kworker.0 Request processed in 10016us (10497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845985.605673:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788845985.605714:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788845985.605724:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702393728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.605758:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702393728:12345-0@lo:400:kworker.0 Request processed in 36us (10456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845985.605763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788845985.605777:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788845985.605785:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702394240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.605815:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702394240:12345-0@lo:400:kworker.0 Request processed in 31us (10483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845985.605820:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1788845985.605927:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845985.605933:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788845985.605935:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788845985.605983:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702393856:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.605995:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702394368:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.606049:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702393984:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.606112:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702393728:0@lo:400:kworker.0 00010000:00080000:2.0:1788845985.606125:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4e00 x1875740702394240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845985.606147:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702394240:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.606159:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702393600:0@lo:400:kworker.0 00000100:00100000:2.0:1788845985.606167:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702394112:0@lo:400:kworker.0 00000100:00100000:1.0:1788845985.606338:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788845985.606454:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702394752:12345-0@lo:400:kworker.0 Request processed in 10729us (11095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845985.606462:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788845985.606558:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f47ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702394752:0@lo:400:kworker.0 00000100:00100000:0.0:1788845985.607206:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702394496:12345-0@lo:400:kworker.0 Request processed in 8705us (12430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845985.607214:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:2.0:1788845985.610274:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f478000 x1875740702394496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845985.610303:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702394496:0@lo:400:kworker.0 00000100:00100000:2.0:1788845986.106177:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845986.106199:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702394880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845986.106265:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845986.106447:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702394880 00000100:00100000:1.0:1788845986.106456:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702394880 00000100:00100000:1.0:1788845986.106503:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788845986.106512:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702394880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788845986.106574:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845986.106634:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702394880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845986.106641:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788845986.106773:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702395008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845986.106807:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845986.106859:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4412af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702394880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788845986.106928:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702395008 00000100:00100000:0.0:1788845986.106933:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702395008 00000100:00100000:0.0:1788845986.106966:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788845986.106973:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702395008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845986.106983:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845986.107028:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702395008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845986.107034:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788845986.107132:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702395008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788845986.617978:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845987.195895:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845987.195939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845987.195986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845987.196080:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683432832 00000100:00100000:2.0:1788845987.196090:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683432832 00000100:00100000:2.0:1788845987.196156:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683432704 00000100:00100000:2.0:1788845987.196159:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683432704 00000100:00100000:2.0:1788845987.196198:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:2.0:1788845987.196208:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683432832:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845987.196298:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683432832:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 93us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845987.196310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:2.0:1788845987.196328:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00100000:2.0:1788845987.196335:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683432704:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845987.196365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683432704:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845987.196381:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00080000:1.0:1788845987.196565:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788845987.196570:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788845987.196632:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683432576 00000100:00100000:0.0:1788845987.196637:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683432576 00000100:00100000:0.0:1788845987.196683:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 372 00000100:00100000:0.0:1788845987.196691:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683432576:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845987.196719:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450dba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683432576:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 29us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845987.196725:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 372 00000100:00100000:2.0:1788845987.210033:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845987.210080:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845987.210111:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845987.210317:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683433088 00000100:00100000:1.0:1788845987.210325:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683432960 00000100:00100000:3.0:1788845987.210329:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683433088 00000100:00100000:1.0:1788845987.210331:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683432960 00000100:00100000:0.0:1788845987.210408:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683433216 00000100:00100000:0.0:1788845987.210413:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683433216 00000100:00100000:1.0:1788845987.210481:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1788845987.210491:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2397:x1875740683432960:12345-192.168.203.20@tcp:9:kworker.0 00000020:00000080:1.0:1788845987.210566:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271b54 00000100:00080000:1.0:1788845987.210575:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90e47f428800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788845987.210619:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788845987.210721:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:3.0:1788845987.210732:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683433088:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788845987.210797:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683433088:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 67us (716us total) trans 0 rc 0/0 00000100:00080000:2.0:1788845987.210798:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788845987.210804:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845987.210806:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845987.210824:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 234 00010000:00010000:3.0:1788845987.210871:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845987.210976:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+2:2397:x1875740683432960:12345-192.168.203.20@tcp:9:kworker.0 Request processed in 486us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845987.210983:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:0.0:1788845987.211802:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 235 00000100:00100000:0.0:1788845987.211813:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683433216:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845987.211871:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683433216:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 60us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845987.211877:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 235 00010000:00010000:0.0:1788845987.641877:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845987.642609:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702395136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788845987.642687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845987.642843:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702395136 00000100:00100000:2.0:1788845987.642851:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702395136 00000100:00100000:2.0:1788845987.642908:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788845987.642917:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702395136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788845987.642947:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845987.645400:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702395136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2476us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845987.645414:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788845987.648558:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702395136:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788845988.665799:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845989.691436:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845990.201980:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845990.202006:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702395264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788845990.202086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845990.203050:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702395264 00000100:00100000:1.0:1788845990.203062:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702395264 00000100:00100000:1.0:1788845990.203140:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788845990.203152:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702395264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845990.203182:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845990.203241:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702395264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845990.203261:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788845990.203327:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788845990.203563:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f479880 x1875740702395264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845990.203593:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f479880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702395264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788845990.206791:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845990.206816:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702395392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788845990.206887:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845990.207006:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702395392 00000100:00100000:3.0:1788845990.207014:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702395392 00000100:00100000:3.0:1788845990.207088:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788845990.207099:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702395392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788845990.207121:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788845990.207169:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702395392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845990.207175:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1788845990.207228:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a5500 x1875740702395392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845990.207247:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702395392:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788845990.208416:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788845990.714038:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845990.714088:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845990.714108:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702395520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788845990.714185:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845990.714290:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702395648:0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714331:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845990.714354:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702396160:0@lo:400:kworker.0 00000100:00100000:2.0:1788845990.714357:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702395648 00000100:00100000:2.0:1788845990.714377:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702395648 00000100:00100000:1.0:1788845990.714379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845990.714395:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702396672:0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845990.714420:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788845990.714429:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702395648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714433:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788845990.714438:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702395776:0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845990.714470:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702395648:12345-0@lo:400:kworker.0 Request processed in 43us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845990.714471:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702396288:0@lo:400:kworker.0 00000100:00100000:2.0:1788845990.714477:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788845990.714489:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845990.714501:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702396800:0@lo:400:kworker.0 00000100:00100000:2.0:1788845990.714547:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702396672 00000100:00100000:1.0:1788845990.714549:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845990.714551:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702396672 00000100:00100000:1.0:1788845990.714576:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702395648:0@lo:400:kworker.0 00000100:00100000:2.0:1788845990.714578:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702396800 00000100:00100000:2.0:1788845990.714580:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702396800 00000100:00100000:2.0:1788845990.714597:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788845990.714601:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702396160 00000100:00100000:2.0:1788845990.714604:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702396672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714604:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702396160 00000100:00100000:1.0:1788845990.714628:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702395776 00000100:00100000:1.0:1788845990.714630:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702395776 00000100:00100000:2.0:1788845990.714638:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702396672:12345-0@lo:400:kworker.0 Request processed in 35us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845990.714643:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702396288 00000100:00100000:2.0:1788845990.714644:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788845990.714645:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702396288 00000100:00100000:2.0:1788845990.714654:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788845990.714657:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788845990.714660:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702396800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714663:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702396160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845990.714684:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702396800:12345-0@lo:400:kworker.0 Request processed in 24us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845990.714685:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702396160:12345-0@lo:400:kworker.0 Request processed in 23us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845990.714689:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788845990.714690:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788845990.714700:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00080000:2.0:1788845990.714703:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788845990.714705:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702395776:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788845990.714707:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845990.714709:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788845990.714730:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788845990.714737:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e341e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702396288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714743:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702395776:12345-0@lo:400:kworker.0 Request processed in 38us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845990.714748:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788845990.714762:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e341e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702396288:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845990.714767:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702395904:0@lo:400:kworker.0 00000100:00100000:2.0:1788845990.714776:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788845990.714787:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845990.714801:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702396416:0@lo:400:kworker.0 00000100:00100000:2.0:1788845990.714803:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702396032:0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714821:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845990.714822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845990.714835:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702396544:0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714843:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702395904 00000100:00100000:1.0:1788845990.714845:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702395904 00000100:00100000:2.0:1788845990.714853:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845990.714859:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702396416 00000100:00100000:1.0:1788845990.714861:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702396416 00000100:00080000:2.0:1788845990.714876:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788845990.714878:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702396544 00000100:00100000:1.0:1788845990.714886:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702396544 00000100:00100000:1.0:1788845990.714909:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00080000:2.0:1788845990.714910:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788845990.714915:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702395904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714949:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702395904:12345-0@lo:400:kworker.0 Request processed in 33us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845990.714954:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788845990.714966:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788845990.714972:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702396416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.714998:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702396416:12345-0@lo:400:kworker.0 Request processed in 27us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845990.715265:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702395520 00000100:00100000:0.0:1788845990.715270:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702395520 00000100:00100000:0.0:1788845990.715304:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702396032 00000100:00100000:0.0:1788845990.715307:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702396032 00000100:00100000:0.0:1788845990.715320:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788845990.715326:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702395520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788845990.715350:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788845990.715385:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702395520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845990.715391:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788845990.715403:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788845990.715408:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702396032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845990.715428:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788845990.715437:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702396544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788845990.715450:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702396032:12345-0@lo:400:kworker.0 Request processed in 42us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845990.715456:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788845990.715466:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702396544:12345-0@lo:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845990.715472:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788845990.715486:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702396032:0@lo:400:kworker.0 00010000:00080000:0.0:1788845990.715499:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3edf80 x1875740702396544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845990.715515:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702395904:0@lo:400:kworker.0 00000100:00100000:3.0:1788845990.715542:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702396416:0@lo:400:kworker.0 00000100:00100000:0.0:1788845990.715547:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702396544:0@lo:400:kworker.0 00000100:00100000:3.0:1788845990.715557:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702395520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788845990.715582:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702395776:0@lo:400:kworker.0 00010000:00080000:3.0:1788845990.715603:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3ef100 x1875740702396288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845990.715611:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702396288:0@lo:400:kworker.0 00000100:00100000:3.0:1788845990.715619:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702396800:0@lo:400:kworker.0 00000100:00100000:3.0:1788845990.715627:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702396160:0@lo:400:kworker.0 00000100:00100000:3.0:1788845990.715634:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f457480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702396672:0@lo:400:kworker.0 00000100:00100000:1.0:1788845990.715876:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788845991.226294:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845991.226315:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702396928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788845991.226383:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845991.226481:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702396928 00000100:00100000:1.0:1788845991.226489:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702396928 00000100:00100000:1.0:1788845991.226560:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788845991.226570:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702396928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788845991.226596:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845991.226638:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f457100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702396928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845991.226644:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788845991.226683:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702396928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788845991.227198:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788845991.227210:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702397056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788845991.227255:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845991.227332:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702397056 00000100:00100000:0.0:1788845991.227337:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702397056 00000100:00100000:0.0:1788845991.227373:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788845991.227382:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702397056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788845991.227394:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845991.227438:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702397056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845991.227445:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788845991.227510:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702397056:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788845991.738149:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845992.304950:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845992.304992:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845992.305031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845992.305052:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788845992.305058:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683433472 00000100:00100000:1.0:1788845992.305068:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683433472 00000100:00100000:2.0:1788845992.305072:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845992.305090:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683433344 00000100:00100000:2.0:1788845992.305093:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683433344 00000100:00100000:1.0:1788845992.305119:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683433728 00000100:00100000:1.0:1788845992.305121:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683433728 00000100:00100000:2.0:1788845992.305123:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 374 00000100:00100000:2.0:1788845992.305132:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683433344:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845992.305133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683433600 00000100:00100000:1.0:1788845992.305136:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683433600 00000100:00100000:1.0:1788845992.305146:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683433856 00000100:00100000:1.0:1788845992.305160:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683433856 00000100:00100000:1.0:1788845992.305175:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:1.0:1788845992.305181:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683433472:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845992.305191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683433344:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845992.305199:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 374 00000100:00100000:1.0:1788845992.305208:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683433472:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845992.305214:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:1.0:1788845992.305225:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 243 00000100:00100000:1.0:1788845992.305231:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683433728:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845992.305263:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683433728:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845992.305269:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 243 00000100:00100000:1.0:1788845992.305280:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:1.0:1788845992.305286:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683433600:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788845992.305309:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683433600:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845992.305316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00080000:2.0:1788845992.305386:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788845992.305390:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788845992.308836:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:0.0:1788845992.308872:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683433856:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845992.308965:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683433856:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 106us (3889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845992.320839:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:1.0:1788845992.764163:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4752a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702397184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788845992.764260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845992.764366:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702397184 00000100:00100000:1.0:1788845992.764374:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702397184 00000100:00100000:1.0:1788845992.764420:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788845992.764430:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702397184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788845992.764463:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788845992.764511:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702397184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845992.764546:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788845992.764600:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4752a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702397184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788845992.764772:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788845992.766069:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:1.0:1788845992.766077:0:9508:0:(genops.c:885:class_export_put()) final put ffff90e4437d1000/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:2.0:1788845992.766299:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4437d1000/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 for lustre-OST0001 00000020:00000080:2.0:1788845992.766356:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47f428800 for lustre-OST0001 00010000:00010000:2.0:1788845993.788072:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788845994.106277:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788845994.108695:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788845994.809813:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788845995.321808:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702397312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788845995.321878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845995.321953:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702397312 00000100:00100000:1.0:1788845995.321961:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702397312 00000100:00100000:1.0:1788845995.322011:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788845995.322021:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702397312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788845995.322048:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845995.322104:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702397312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845995.322111:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788845995.322131:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788845995.322439:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f50a300 x1875740702397312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788845995.322458:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702397312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788845995.324009:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702397440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788845995.324068:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845995.324988:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702397440 00000100:00100000:1.0:1788845995.324997:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702397440 00000100:00100000:1.0:1788845995.325131:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788845995.325346:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702397440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788845995.325369:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845995.325438:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702397440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845995.325458:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:0.0:1788845995.325554:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a4380 x1875740702397440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788845995.325585:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702397440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788845995.325667:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788845995.833894:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702397568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788845995.833967:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845995.834039:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702397568 00000100:00100000:2.0:1788845995.834047:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702397568 00000100:00100000:2.0:1788845995.834099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788845995.834110:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702397568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788845995.834162:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788845995.834228:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702397568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.834237:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788845995.834292:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702397568:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788845995.834569:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845995.834835:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702397696:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.834874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845995.834904:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788845995.834910:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702397824:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.834935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845995.834956:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845995.834963:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702397952:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.834985:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845995.835011:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702397696 00000100:00100000:2.0:1788845995.835016:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702397696 00000100:00100000:2.0:1788845995.835044:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788845995.835051:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702397696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.835102:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702397696:12345-0@lo:400:kworker.0 Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.835108:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788845995.835134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702397824 00000100:00100000:2.0:1788845995.835138:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702397824 00000100:00100000:2.0:1788845995.835162:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702397952 00000100:00100000:2.0:1788845995.835165:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702397952 00000100:00100000:2.0:1788845995.835184:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788845995.835190:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702397824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.835231:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702397824:12345-0@lo:400:kworker.0 Request processed in 41us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.835236:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788845995.835249:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788845995.835254:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702397952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.835284:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702397952:12345-0@lo:400:kworker.0 Request processed in 30us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.835290:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788845995.835322:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702397824:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.835330:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702397696:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.835356:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702397952:0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.835454:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702398336:0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.835482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845995.835503:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702398848:0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.835556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845995.835573:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788845995.835578:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702398208:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.836878:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702398080:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.836932:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845995.836963:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702398592:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.836988:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845995.837023:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788845995.837030:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702398464:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.837052:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845995.837083:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702398848 00000100:00100000:2.0:1788845995.837091:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702398848 00000100:00100000:2.0:1788845995.837136:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788845995.837144:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702398848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.837186:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702398848:12345-0@lo:400:kworker.0 Request processed in 43us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.837192:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788845995.837225:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702398080 00000100:00100000:2.0:1788845995.837229:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702398080 00000100:00100000:2.0:1788845995.837251:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788845995.837258:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702398080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.837295:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702398080:12345-0@lo:400:kworker.0 Request processed in 38us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.837302:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788845995.837317:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702398336 00000100:00100000:2.0:1788845995.837321:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702398336 00000100:00100000:2.0:1788845995.837343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702398592 00000100:00100000:2.0:1788845995.837346:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702398592 00000100:00100000:2.0:1788845995.837357:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702398464 00000100:00100000:2.0:1788845995.837359:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702398464 00000100:00100000:2.0:1788845995.837372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788845995.837378:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702398336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.837408:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702398336:12345-0@lo:400:kworker.0 Request processed in 31us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.837414:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788845995.837435:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788845995.837441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702398592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.837467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4751c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702398592:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.837472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788845995.837482:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788845995.837487:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702398464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.837513:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702398464:12345-0@lo:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845995.837537:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:2.0:1788845995.837557:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788845995.837560:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788845995.837562:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788845995.837704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788845995.837726:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702398720:0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.837828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788845995.837866:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f4eea00 x1875740702398336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788845995.837880:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702398336:0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.837892:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702398848:0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.837916:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702398208 00000100:00100000:3.0:1788845995.837920:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702398208 00000100:00100000:3.0:1788845995.837954:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788845995.837960:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702398208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.837994:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875740702398208:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845995.838000:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788845995.838017:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702398720 00000100:00100000:3.0:1788845995.838020:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702398720 00000100:00100000:3.0:1788845995.838043:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788845995.838049:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702398720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.838076:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702398720:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845995.838082:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788845995.838106:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3641:1875740702398208:0@lo:400:kworker.0 00000100:00100000:3.0:1788845995.838115:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702398720:0@lo:400:kworker.0 00000100:00080000:3.0:1788845995.838349:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788845995.838353:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845995.840703:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702398464:0@lo:400:kworker.0 00000100:00100000:2.0:1788845995.840740:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702398080:0@lo:400:kworker.0 00010000:00080000:2.0:1788845995.840764:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f4ed880 x1875740702398592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788845995.840774:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702398592:0@lo:400:kworker.0 00000100:00100000:2.0:1788845996.345766:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702398976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788845996.345836:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788845996.345966:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702398976 00000100:00100000:1.0:1788845996.345974:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702398976 00000100:00100000:1.0:1788845996.346030:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788845996.346040:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702398976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788845996.346066:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788845996.346126:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702398976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845996.346134:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788845996.346180:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702398976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788845996.348189:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788845996.348215:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702399104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788845996.348270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788845996.349055:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702399104 00000100:00100000:0.0:1788845996.349064:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702399104 00000100:00100000:0.0:1788845996.349127:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788845996.349137:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702399104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788845996.349158:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788845996.349233:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702399104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845996.349240:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788845996.349428:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702399104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788845996.858274:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788845997.426932:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845997.427027:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845997.427071:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845997.427094:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845997.427368:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683434112 00000100:00100000:0.0:1788845997.427378:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683434112 00000100:00100000:0.0:1788845997.427446:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683434368 00000100:00100000:0.0:1788845997.427450:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683434368 00000100:00100000:0.0:1788845997.427467:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683434240 00000100:00100000:0.0:1788845997.427469:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683434240 00000100:00100000:0.0:1788845997.427485:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:0.0:1788845997.427494:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683434112:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845997.427590:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2401:x1875740683434112:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 96us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845997.427598:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:0.0:1788845997.427616:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:0.0:1788845997.427623:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683434368:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845997.427649:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683434368:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845997.427656:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:0.0:1788845997.427676:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:0.0:1788845997.427683:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683434240:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788845997.427710:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683434240:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845997.427717:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00080000:0.0:1788845997.427745:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788845997.427750:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845997.428889:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845997.428927:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683433984 00000100:00100000:2.0:1788845997.428935:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683433984 00000100:00100000:2.0:1788845997.428973:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 376 00000100:00100000:2.0:1788845997.428981:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683433984:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845997.429419:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683433984:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 437us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845997.429428:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 376 00000100:00100000:2.0:1788845997.429465:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683434496 00000100:00100000:2.0:1788845997.429469:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683434496 00000100:00100000:2.0:1788845997.429510:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00100000:2.0:1788845997.429518:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683434496:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788845997.429581:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683434496:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 64us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845997.429589:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00080000:1.0:1788845997.431590:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1788845997.826491:0:14056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:39:56 (1788845996) 00000100:00100000:2.0:1788845997.883440:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d32a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702399232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788845997.883513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788845997.883600:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702399232 00000100:00100000:2.0:1788845997.883608:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702399232 00000100:00100000:2.0:1788845997.883780:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788845997.883790:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702399232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788845997.883821:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788845997.883867:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702399232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845997.883885:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788845997.883930:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d32a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702399232:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788845997.884293:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788845998.905763:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788845999.568678:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845999.568784:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683434624 00000100:00100000:2.0:1788845999.568798:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683434624 00000100:00100000:2.0:1788845999.568900:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00080000:1.0:1788845999.568913:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788845999.568916:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:11066:x1875740683434624:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788845999.568951:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788845999.568985:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271c34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754506 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.569072:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271c3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.569090:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.569107:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788845999.569193:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788845999.569197:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788845999.569250:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271c3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.569283:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271c34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754506 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.569306:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271c3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754506 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788845999.569337:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2100) 00010000:00010000:2.0:1788845999.569341:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788845999.569345:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788845999.569427:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:11066:x1875740683434624:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 516us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845999.569435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1788845999.577368:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845999.577482:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683434752 00000100:00100000:0.0:1788845999.577500:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683434752 00000100:00100000:0.0:1788845999.577899:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:0.0:1788845999.577916:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:11067:x1875740683434752:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845999.577946:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845999.577975:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271c42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175450d expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578064:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578082:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578107:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578125:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578133:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578164:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578255:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138271c57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578263:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138271c57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578270:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138271c57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845999.578318:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788845999.578323:0:7876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788845999.578352:0:7876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138271c57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578365:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578372:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578379:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578387:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845999.578392:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578400:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578420:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2100) 00010000:00010000:0.0:1788845999.578423:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845999.578429:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578434:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578449:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578454:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578459:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578464:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845999.578467:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578472:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578479:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90e458422800) 00010000:00010000:0.0:1788845999.578481:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845999.578484:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578489:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578599:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271c42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175450d expref: 8 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578623:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138271c57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175450d expref: 7 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.578632:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e458422600) 00010000:00010000:0.0:1788845999.578634:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788845999.578637:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356600, rc 0) 00000100:00100000:0.0:1788845999.578727:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:11067:x1875740683434752:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 816us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788845999.578736:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1788845999.582434:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788845999.582596:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683434880 00000100:00100000:2.0:1788845999.582608:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683434880 00000100:00100000:2.0:1788845999.582691:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788845999.582703:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:11067:x1875740683434880:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788845999.582810:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:11067:x1875740683434880:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 Request processed in 109us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788845999.582819:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1788845999.587324:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845999.587470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683435136 00000100:00100000:0.0:1788845999.587486:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683435136 00000100:00100000:0.0:1788845999.587858:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:0.0:1788845999.587871:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:11067:x1875740683435136:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788845999.587899:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788845999.587927:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754514 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588027:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588044:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588058:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588654:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588679:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588692:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588892:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356c00/0x21b4d56138271c73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588902:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356c00/0x21b4d56138271c73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.588909:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356c00/0x21b4d56138271c73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788845999.588921:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788845999.589090:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589099:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589106:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589112:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845999.589117:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589142:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589156:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e458422600) 00010000:00010000:0.0:1788845999.589159:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845999.589163:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589169:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271c65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589182:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589197:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589203:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589209:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788845999.589211:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589218:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589224:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90e458422800) 00010000:00010000:0.0:1788845999.589227:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845999.589229:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.589245:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271c6c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.590852:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271c5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754514 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.591116:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356c00/0x21b4d56138271c73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754514 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788845999.591129:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:0.0:1788845999.591131:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788845999.591134:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356c00, rc 0) 00000100:00100000:0.0:1788845999.591214:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:11067:x1875740683435136:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3346us (3905us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788845999.591224:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:0.0:1788845999.600600:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788845999.600699:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683435264 00000100:00100000:3.0:1788845999.600735:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683435264 00000100:00100000:3.0:1788845999.600814:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:3.0:1788845999.600824:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:11067:x1875740683435264:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788845999.600962:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:11067:x1875740683435264:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 140us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788845999.600970:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1788845999.605857:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788845999.606247:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683435392 00000100:00100000:0.0:1788845999.606262:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683435392 00000100:00100000:0.0:1788845999.606396:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1788845999.606410:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:11067:x1875740683435392:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788845999.606439:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788845999.607731:0:7876:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1258us 00000100:00100000:1.0:1788845999.628213:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:11067:x1875740683435392:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 21782us (22345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788845999.628233:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00010000:00010000:0.0:1788845999.930044:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788846000.250320:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788846000.250682:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846000.447371:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702399488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846000.447473:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846000.450886:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702399360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788846000.451009:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846000.451110:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702399488 00000100:00100000:1.0:1788846000.451123:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702399488 00000100:00100000:0.0:1788846000.451272:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702399360 00000100:00100000:0.0:1788846000.451277:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702399360 00000100:00100000:0.0:1788846000.451328:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788846000.451344:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702399360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788846000.451383:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788846000.451434:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702399360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846000.451441:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788846000.453838:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846000.453995:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788846000.454011:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702399488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788846000.454044:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846000.454481:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702399488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (6679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846000.454490:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788846000.454586:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f50a300 x1875740702399360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846000.455273:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f50a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702399360:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788846000.455345:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4380 x1875740702399488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846000.455364:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702399488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846000.955058:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702399744:0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846000.955221:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702400256:0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955248:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846000.955264:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955287:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846000.955312:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788846000.955317:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702399872:0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955336:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846000.955351:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702400384:0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846000.955385:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702400896:0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846000.955440:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702400768 00000100:00100000:0.0:1788846000.955449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702400768 00000100:00100000:0.0:1788846000.955511:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702399872 00000100:00100000:0.0:1788846000.955513:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702399872 00000100:00100000:0.0:1788846000.955568:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788846000.955577:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702400768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955631:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702400768:12345-0@lo:400:kworker.0 Request processed in 55us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846000.955651:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788846000.955670:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702400384 00000100:00100000:0.0:1788846000.955673:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702400384 00000100:00100000:0.0:1788846000.955690:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788846000.955695:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702399872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955724:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702399872:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846000.955730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788846000.955739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788846000.955745:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702400384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955765:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702400384:12345-0@lo:400:kworker.0 Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846000.955771:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:0.0:1788846000.955791:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788846000.955795:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846000.955830:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702399872:0@lo:400:kworker.0 00000100:00100000:0.0:1788846000.955839:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702400384:0@lo:400:kworker.0 00010000:00080000:0.0:1788846000.955851:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1c00 x1875740702400768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846000.955862:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702400768:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956151:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702399616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846000.956202:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846000.956229:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702400128:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956250:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846000.956266:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702400640:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956300:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846000.956319:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788846000.956324:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702400000:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956342:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846000.956361:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702400512:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956380:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846000.956392:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702401024:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846000.956436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702399744 00000100:00100000:2.0:1788846000.956440:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702399744 00000100:00100000:2.0:1788846000.956473:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788846000.956479:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702399744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956515:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702399744:12345-0@lo:400:kworker.0 Request processed in 36us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846000.956546:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788846000.956576:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702400256 00000100:00100000:2.0:1788846000.956580:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702400256 00000100:00100000:2.0:1788846000.956594:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702399616 00000100:00100000:2.0:1788846000.956596:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702399616 00000100:00100000:2.0:1788846000.956606:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702400000 00000100:00100000:2.0:1788846000.956608:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702400000 00000100:00100000:2.0:1788846000.956619:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788846000.956625:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702400256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956654:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702400256:12345-0@lo:400:kworker.0 Request processed in 29us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846000.956660:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788846000.956670:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788846000.956675:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875740702399616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846000.956701:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788846000.956730:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1875740702399616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846000.956745:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788846000.956764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788846000.956768:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702400000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956791:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702400000:12345-0@lo:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846000.956797:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788846000.956812:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702400896 00000100:00100000:2.0:1788846000.956815:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702400896 00000100:00100000:2.0:1788846000.956844:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702401024 00000100:00100000:2.0:1788846000.956846:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702401024 00000100:00100000:2.0:1788846000.956862:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788846000.956867:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702400896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956894:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702400896:12345-0@lo:400:kworker.0 Request processed in 28us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846000.956900:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788846000.956911:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788846000.956917:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702401024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.956958:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702401024:12345-0@lo:400:kworker.0 Request processed in 41us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846000.956965:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788846000.956985:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702400128 00000100:00100000:2.0:1788846000.956989:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702400128 00000100:00100000:2.0:1788846000.957005:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702400640 00000100:00100000:2.0:1788846000.957008:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702400640 00000100:00100000:2.0:1788846000.957019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702400512 00000100:00100000:2.0:1788846000.957021:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702400512 00000100:00100000:2.0:1788846000.957033:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788846000.957046:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d32a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702400128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846000.958467:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788846000.958489:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702400640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846000.958607:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702400640:12345-0@lo:400:kworker.0 Request processed in 128us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846000.958614:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788846000.958640:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788846000.958647:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702400512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846000.958679:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702400512:12345-0@lo:400:kworker.0 Request processed in 32us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846000.958685:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00010000:3.0:1788846000.958705:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846000.959228:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d32a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702400128:12345-0@lo:400:kworker.0 Request processed in 2179us (2973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846000.959237:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:2.0:1788846000.959314:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788846000.959321:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788846000.959326:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846000.959373:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702400000:0@lo:400:kworker.0 00010000:00080000:2.0:1788846000.959392:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b2a00 x1875740702400512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846000.959403:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702400512:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.959418:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702401024:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.959441:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702399616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846000.959454:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702400128:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.959465:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702400640:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.959697:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702400896:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.959710:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702399744:0@lo:400:kworker.0 00000100:00100000:2.0:1788846000.959723:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702400256:0@lo:400:kworker.0 00000100:00100000:1.0:1788846001.465710:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846001.465742:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702401152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846001.465846:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846001.465929:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702401152 00000100:00100000:1.0:1788846001.465938:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702401152 00000100:00100000:1.0:1788846001.465999:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788846001.466010:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702401152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788846001.466049:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846001.466097:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702401152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846001.466114:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788846001.466188:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702401152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846001.469980:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702401280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788846001.470064:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846001.470777:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702401280 00000100:00100000:1.0:1788846001.470790:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702401280 00000100:00100000:1.0:1788846001.470849:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788846001.470859:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702401280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788846001.470889:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846001.470957:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702401280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846001.470967:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788846001.471022:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702401280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846001.911599:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846001.912253:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683435520 00000100:00100000:3.0:1788846001.912264:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683435520 00000100:00080000:2.0:1788846001.912348:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846001.912359:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1788846001.912372:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:11109:x1875740683435520:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846001.912391:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846001.912425:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271c81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175451b expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912489:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912504:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912539:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912555:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912563:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912569:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912612:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912619:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912624:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912629:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846001.912633:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912649:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912661:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2100) 00010000:00010000:3.0:1788846001.912664:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846001.912668:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912674:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271c88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912687:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912694:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912699:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912704:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846001.912706:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912711:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912717:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90e461481700) 00010000:00010000:3.0:1788846001.912719:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846001.912722:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912738:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271c8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912769:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271c81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175451b expref: 10 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912779:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2100) 00010000:00010000:3.0:1788846001.912781:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846001.912784:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271c81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175451b expref: 10 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846001.912793:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065e00, rc 0) 00000100:00100000:3.0:1788846001.912860:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:11109:x1875740683435520:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 492us (1269us total) trans 0 rc 301/301 00000100:00100000:3.0:1788846001.912867:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1788846001.927834:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846001.932554:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683435776 00000100:00100000:1.0:1788846001.932570:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683435776 00000100:00100000:1.0:1788846001.932654:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:1.0:1788846001.932664:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:11109:x1875740683435776:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:1.0:1788846001.932732:0:7876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846001.932758:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271c3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754506 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.932777:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e342aa2100) 00010000:00010000:1.0:1788846001.933252:0:7876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788846001.933317:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.933332:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.933355:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.933368:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.933374:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.933380:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935319:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935338:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935347:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788846001.935363:0:7876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecb2f617 reply state 0000000098c12753 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935372:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935379:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:1.0:1788846001.935381:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788846001.935385:0:7876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788846001.935390:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788846001.935397:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935416:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935422:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935429:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846001.935433:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935440:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935449:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e451775800) 00010000:00010000:1.0:1788846001.935451:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846001.935455:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935459:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271c96 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788846001.935476:0:7876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ecb2f617 reply state 0000000098c12753 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.935484:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846001.936399:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90e451775d00) 00010000:00010000:1.0:1788846001.936402:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788846001.936406:0:7876:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788846001.936546:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:11109:x1875740683435776:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 3880us (8717us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788846001.936559:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00010000:00010000:2.0:1788846001.988444:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846002.035272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.035304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683435904 00000100:00100000:2.0:1788846002.035322:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683435904 00000100:00100000:2.0:1788846002.035373:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:2.0:1788846002.035383:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:11117:x1875740683435904:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:2.0:1788846002.035406:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846002.035429:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271cab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754522 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.035490:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271cb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.035502:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.035514:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846002.035578:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788846002.035582:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846002.035631:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.035657:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271cab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754522 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.035672:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754522 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.035690:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:2.0:1788846002.035694:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846002.035697:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c800, rc 0) 00000100:00100000:2.0:1788846002.035863:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:11117:x1875740683435904:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 480us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.035871:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1788846002.103952:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846002.106618:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683436032 00000100:00100000:3.0:1788846002.106632:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683436032 00000100:00100000:3.0:1788846002.106716:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:3.0:1788846002.106862:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:11123:x1875740683436032:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846002.106882:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846002.106902:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271cb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754529 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.106964:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.106992:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107004:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107016:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107023:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107029:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107111:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271cce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107119:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107126:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846002.107157:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788846002.107160:0:12145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846002.107207:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271cce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107218:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107233:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107238:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107244:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846002.107247:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107255:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107267:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:3.0:1788846002.107270:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846002.107274:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107280:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271cc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107294:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107300:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107305:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107310:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846002.107320:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107326:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107335:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90e451775d00) 00010000:00010000:3.0:1788846002.107338:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846002.107341:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107347:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271cc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107385:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271cb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754529 expref: 13 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107400:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271cce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754529 expref: 12 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.107408:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846002.107410:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788846002.107413:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065c00, rc 0) 00000100:00100000:3.0:1788846002.107476:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:11123:x1875740683436032:12345-192.168.203.20@tcp:101:bash.0 Request processed in 619us (3532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846002.107483:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:2.0:1788846002.121483:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846002.123274:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683436288 00000100:00100000:1.0:1788846002.123287:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683436288 00000100:00100000:1.0:1788846002.123365:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:1.0:1788846002.123377:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:11123:x1875740683436288:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1788846002.123397:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846002.123418:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271cd5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754530 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.123557:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.123572:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.123593:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.123653:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.123660:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.123667:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788846002.124219:0:7876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788846002.124361:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124379:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124387:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124420:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124427:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124434:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124441:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846002.124445:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124453:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124465:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:1.0:1788846002.124469:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846002.124473:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124479:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271cdc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788846002.124492:0:7876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087f291de reply state 000000005fa626e5 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124511:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.124517:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:1.0:1788846002.125288:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788846002.125293:0:7876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788846002.125335:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271cd5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 15 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.125353:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 14 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.125360:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e451775300) 00010000:00010000:1.0:1788846002.125363:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846002.125365:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2e00, rc 0) 00000100:00100000:1.0:1788846002.125426:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:11123:x1875740683436288:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2052us (3953us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788846002.125434:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:0.0:1788846002.131558:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.131647:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683436416 00000100:00100000:2.0:1788846002.131657:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683436416 00000100:00100000:2.0:1788846002.131717:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1788846002.131734:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875740683436416:12345-192.168.203.20@tcp:8:bash.0 00010000:00080000:2.0:1788846002.131765:0:8906:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:2.0:1788846002.131794:0:8906:0:(genops.c:1385:class_connect()) connect: client 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635, cookie 0x21b4d56138271cf8 00002000:00100000:2.0:1788846002.131806:0:8906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635/ffff90e343be6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788846002.131823:0:8906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788846002.131895:0:8906:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788846002.131923:0:8906:0:(import.c:65:import_set_state_nolock()) ffff90e343be3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846002.131983:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2397:x1875740683436416:12345-192.168.203.20@tcp:8:bash.0 Request processed in 249us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.131991:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:0.0:1788846002.143290:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.143393:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683436544 00000100:00100000:2.0:1788846002.143403:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683436544 00000100:00100000:2.0:1788846002.143473:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1788846002.143483:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:0:x1875740683436544:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846002.143500:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846002.143563:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754537 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846002.143597:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846002.143622:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788846002.143627:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846002.143641:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.143663:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.143685:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788846002.143750:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:0:x1875740683436544:12345-192.168.203.20@tcp:101:bash.0 Request processed in 268us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.143756:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00080000:0.0:1788846002.144070:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846002.148931:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.149090:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683436672 00000100:00100000:2.0:1788846002.149100:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683436672 00000100:00100000:2.0:1788846002.149158:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1788846002.149179:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:11123:x1875740683436672:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846002.149197:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846002.149215:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175453e expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.149247:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.149257:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846002.149262:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846002.149267:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.149315:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.149329:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 8 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846002.149344:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343652300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875740702401408:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846002.149448:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d196540 going to sleep for 11 seconds 00000100:00100000:2.0:1788846002.153864:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343652300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875740702401408:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846002.153899:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.153920:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d800, rc 0) 00000100:00100000:2.0:1788846002.153980:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:11123:x1875740683436672:12345-192.168.203.20@tcp:101:bash.0 Request processed in 4812us (5059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.153989:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:3.0:1788846002.156877:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846002.157025:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683436800 00000100:00100000:0.0:1788846002.157034:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683436800 00010000:00010000:0.0:1788846002.157074:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 8 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846002.157116:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:0.0:1788846002.157126:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683436800:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846002.157150:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846002.157184:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 8 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.157198:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 8 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.157222:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138271cff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754537 expref: 8 pid: 8430 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.157240:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846002.157244:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846002.157251:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.157261:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.157296:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846002.157325:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6502:1875740702401536:192.168.203.20@tcp:105: 00000100:00100000:0.0:1788846002.157407:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e44505d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846002.161029:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846002.162125:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683437056 00000100:00100000:1.0:1788846002.162140:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683437056 00000100:00100000:1.0:1788846002.162219:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:1.0:1788846002.162230:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:11123:x1875740683437056:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:1.0:1788846002.162547:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:11123:x1875740683437056:12345-192.168.203.20@tcp:35:bash.0 Request processed in 293us (1508us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788846002.162558:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1788846002.164938:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6502:1875740702401536:192.168.203.20@tcp:105: 00010000:00010000:0.0:1788846002.164964:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846002.165036:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683436800:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 7911us (8166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846002.165048:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:3.0:1788846002.274668:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.274959:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683437312 00000100:00100000:2.0:1788846002.274972:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683437312 00000100:00100000:2.0:1788846002.275048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:2.0:1788846002.275060:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:11133:x1875740683437312:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846002.275093:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846002.275118:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754545 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846002.275293:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788846002.275439:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754545 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.275458:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:2.0:1788846002.275462:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846002.275468:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754545 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.275487:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d000, rc 0) 00000100:00100000:2.0:1788846002.275633:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:11133:x1875740683437312:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 574us (978us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788846002.275642:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1788846002.280554:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846002.280684:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683437568 00000100:00100000:3.0:1788846002.280709:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683437568 00000100:00100000:0.0:1788846002.281587:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1788846002.281604:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:11133:x1875740683437568:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1788846002.281836:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:11133:x1875740683437568:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 237us (1322us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788846002.281845:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1788846002.357458:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.358132:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683437696 00000100:00100000:2.0:1788846002.358152:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683437696 00000100:00100000:2.0:1788846002.358260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1788846002.358274:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:11139:x1875740683437696:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846002.358309:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846002.358344:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175454c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.358438:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271d22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.358457:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271d22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.358494:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271d22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846002.358618:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788846002.358623:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846002.358649:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271d22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.358680:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175454c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.358703:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271d22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175454c expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.358712:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846002.358715:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846002.358719:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42dc00, rc 0) 00000100:00100000:2.0:1788846002.358800:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:11139:x1875740683437696:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 530us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.358807:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1788846002.368181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846002.369096:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683437952 00000100:00100000:1.0:1788846002.369107:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683437952 00000100:00100000:1.0:1788846002.369188:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:1.0:1788846002.369199:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:11139:x1875740683437952:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846002.369219:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846002.369239:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271d29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754553 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.369340:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271d30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.369354:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.369366:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846002.369376:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788846002.369622:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271d29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754553 expref: 22 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.369640:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271d30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754553 expref: 21 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.369649:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e451775300) 00010000:00010000:1.0:1788846002.369652:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846002.369655:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3600, rc 0) 00000100:00100000:1.0:1788846002.370486:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:11139:x1875740683437952:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1285us (2323us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788846002.370511:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:1.0:1788846002.375372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846002.375497:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683438208 00000100:00100000:3.0:1788846002.375507:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683438208 00000100:00100000:3.0:1788846002.375589:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1788846002.375600:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:11139:x1875740683438208:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846002.375623:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846002.375643:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271d3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175455a expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.375740:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271d45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.375755:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.375767:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271d45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846002.375780:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788846002.375881:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271d3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175455a expref: 24 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.375898:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271d45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175455a expref: 23 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.375907:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e451775300) 00010000:00010000:3.0:1788846002.375910:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788846002.375913:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846002.375986:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:11139:x1875740683438208:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 388us (621us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788846002.376103:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:0.0:1788846002.389422:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846002.390254:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683438336 00000100:00100000:3.0:1788846002.390265:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683438336 00000100:00100000:3.0:1788846002.390336:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:3.0:1788846002.390346:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:2398:x1875740683438336:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846002.390360:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846002.390396:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271d30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754553 expref: 23 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.390418:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e451775300) 00010000:00010000:3.0:1788846002.390423:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846002.390484:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:2398:x1875740683438336:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 139us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846002.390491:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1788846002.398866:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846002.398950:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683438464 00000100:00100000:3.0:1788846002.398960:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683438464 00000100:00100000:3.0:1788846002.399031:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:3.0:1788846002.399042:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683438464:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:3.0:1788846002.399088:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.399108:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.399117:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846002.399135:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846002.399151:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.399198:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.399213:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 7 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846002.399227:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875740702401664:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846002.399456:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846002.402946:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875740702401664:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846002.402976:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846002.403845:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846002.403928:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683438592 00000100:00100000:0.0:1788846002.403936:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683438592 00002000:00100000:0.0:1788846002.403975:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff90e343651180 x1875740683438592/t0(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:353/0 lens 504/0 e 0 to 0 dl 1788846013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788846002.403987:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e343651180 with x1875740683438592 ext(0->12) 00010000:00010000:0.0:1788846002.403995:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 8 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.404008:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 8 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846002.404028:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e343651180 00000100:00100000:0.0:1788846002.404059:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1788846002.404068:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2399:x1875740683438592:12345-192.168.203.20@tcp:4:lfs.0 00000001:00100000:2.0:1788846002.407291:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000100:00100000:0.0:1788846002.408372:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2399:x1875740683438592:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 4287us (4512us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788846002.408384:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00002000:00100000:0.0:1788846002.408396:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff90e343651180 x1875740683438592/t4294967300(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:353/0 lens 504/448 e 0 to 0 dl 1788846013 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788846002.408407:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e343651180 with x1875740683438592 ext(0->12) 00010000:00010000:0.0:1788846002.408417:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 9 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.408435:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 9 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846002.408443:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e343651180 00000100:00100000:1.0:1788846002.417199:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846002.417743:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683438720 00000100:00100000:0.0:1788846002.417754:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683438720 00010000:00010000:0.0:1788846002.417795:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 9 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846002.417837:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:0.0:1788846002.417848:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683438720:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846002.417880:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788846002.417898:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788846002.417902:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788846002 00002000:00010000:0.0:1788846002.417905:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788846002 00002000:00010000:0.0:1788846002.417907:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788846002 00002000:00010000:0.0:1788846002.417909:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788846002.417916:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 9 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.417930:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 9 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.417953:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022c41963/0x21b4d56138271d06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175453e expref: 9 pid: 8906 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.417970:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846002.417974:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846002.417980:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.417988:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.418026:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846002.418085:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683438720:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 239us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846002.418093:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00010000:00010000:2.0:1788846002.419195:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.419212:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.419248:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.419257:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.419265:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.419272:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846002.419276:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.419286:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.419301:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.419308:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be1326ca/0x21b4d56138271d53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846002.419395:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683438464:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 20352us (20535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.419404:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1788846002.426375:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.427765:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683438976 00000100:00100000:2.0:1788846002.427779:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683438976 00000100:00100000:2.0:1788846002.427841:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1788846002.427851:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11139:x1875740683438976:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:2.0:1788846002.427905:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271d45 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175455a expref: 22 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846002.428107:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788846002.428153:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788846002.428451:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788846002.428487:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.428502:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 26 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.428511:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.428734:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 26 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.428751:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 26 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846002.428766:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343652d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875740702401792:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846002.428847:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d196540 going to sleep for 11 seconds 00000100:00100000:3.0:1788846002.431404:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.431548:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343652d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875740702401792:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846002.433253:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846002.438812:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683439104 00000100:00100000:0.0:1788846002.438828:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683439104 00010000:00010000:1.0:1788846002.444079:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 27 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846002.444127:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:1.0:1788846002.444149:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:2398:x1875740683439104:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846002.444173:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846002.444180:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 27 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.444193:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 27 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.444216:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d56138271cea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754530 expref: 27 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.444234:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e451775300) 00010000:00010000:1.0:1788846002.444239:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.444248:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.444254:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.444301:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846002.444555:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+26:2398:x1875740683439104:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 417us (13158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846002.444563:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00010000:00010000:2.0:1788846002.444664:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.444672:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846002.444773:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788846002.444878:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788846002.444957:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343652d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702401920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788846002.445011:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846002.445049:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d196d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788846002.445268:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702401920 00000100:00100000:1.0:1788846002.445276:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702401920 00000100:00100000:1.0:1788846002.445328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788846002.445336:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875740702401920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788846002.445428:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875740702401920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846002.445435:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788846002.445471:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343652d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702401920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788846002.445653:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788846002.445700:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702402048:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788846002.445730:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846002.445747:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45033ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846002.445762:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702402048 00000100:00100000:1.0:1788846002.445765:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702402048 00000100:00100000:1.0:1788846002.445786:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788846002.445792:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1875740702402048:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788846002.445869:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1875740702402048:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (138us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788846002.445876:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788846002.445903:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702402048:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788846002.445932:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788846002.445971:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.445979:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.445986:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.445993:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846002.445997:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.446004:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.446016:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e451775300) 00010000:00010000:1.0:1788846002.446019:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788846002.446024:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.446030:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d5a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788846002.446114:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788846002.446195:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788846002.446206:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386483685003ns, next at 387483683199ns, rc = 0 00000001:00080000:1.0:1788846002.446212:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788846002.446231:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e451775300) 00010000:00010000:1.0:1788846002.446233:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788846002.446240:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271d45 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175455a expref: 30 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846002.446322:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:11139:x1875740683438976:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 18472us (19965us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788846002.446330:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000020:00080000:1.0:1788846002.446333:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788846002.446566:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846002.452185:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.452252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683439232 00000100:00100000:2.0:1788846002.452263:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683439232 00000100:00100000:2.0:1788846002.452322:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:2.0:1788846002.452332:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:11139:x1875740683439232:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846002.452356:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846002.452392:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271d61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754561 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.452449:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271d61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754561 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.452464:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271d61 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754561 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.452483:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846002.452496:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846002.452500:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788846002.452949:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:11139:x1875740683439232:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 616us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.452956:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1788846002.458554:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846002.458629:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683439488 00000100:00100000:0.0:1788846002.458638:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683439488 00000100:00100000:0.0:1788846002.458765:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:0.0:1788846002.458775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:11139:x1875740683439488:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1788846002.458988:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+31:11139:x1875740683439488:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 214us (477us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788846002.458995:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1788846002.543974:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846002.544020:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.544123:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683439616 00000100:00100000:2.0:1788846002.544132:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683439616 00000100:00100000:2.0:1788846002.544213:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 378 00000100:00100000:2.0:1788846002.544223:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683439616:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846002.544294:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683439616:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 73us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.544314:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 378 00000100:00100000:3.0:1788846002.545654:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846002.548045:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846002.550004:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683439872 00000100:00100000:1.0:1788846002.550017:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683439872 00000100:00100000:0.0:1788846002.550269:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683439744 00000100:00100000:0.0:1788846002.550274:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683439744 00000100:00080000:1.0:1788846002.550300:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846002.550304:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846002.550332:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 262 00000100:00100000:1.0:1788846002.550344:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683439872:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846002.550436:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683439872:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 95us (6414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846002.550444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 262 00000100:00100000:0.0:1788846002.551086:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 263 00000100:00100000:0.0:1788846002.551096:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683439744:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846002.551138:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683439744:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (5490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846002.551146:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 263 00000100:00100000:0.0:1788846002.553339:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683440000 00000100:00100000:0.0:1788846002.553355:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683440000 00000100:00080000:3.0:1788846002.553409:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846002.553435:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 264 00000100:00100000:0.0:1788846002.553444:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683440000:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846002.554125:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683440000:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 78us (5484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846002.554135:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 264 00000100:00100000:3.0:1788846002.554656:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846002.554882:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683440256 00000100:00100000:0.0:1788846002.554890:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683440256 00000100:00100000:0.0:1788846002.554933:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1788846002.554955:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+31:11149:x1875740683440256:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846002.554975:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846002.554994:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271d68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754568 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846002.555082:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788846002.555186:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271d68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754568 expref: 33 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.555201:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:0.0:1788846002.555205:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846002.555210:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271d68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754568 expref: 33 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.555225:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356000, rc 0) 00000100:00100000:0.0:1788846002.555267:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:11149:x1875740683440256:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 314us (613us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788846002.555274:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1788846002.567868:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.568158:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683440384 00000100:00100000:2.0:1788846002.568176:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683440384 00000100:00100000:2.0:1788846002.568248:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1788846002.568260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:11149:x1875740683440384:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1788846002.568346:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568362:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568373:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568384:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568391:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568410:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568486:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568495:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568502:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846002.568588:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568602:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568608:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568613:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568618:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846002.568622:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568628:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568640:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846002.568648:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846002.568654:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568660:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271d76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568673:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568679:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568685:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568690:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846002.568693:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568699:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568707:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:2.0:1788846002.568709:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846002.568711:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568716:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271d7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568725:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568736:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568743:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568748:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846002.568751:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568757:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568764:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846002.568766:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846002.568769:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.568774:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271d84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846002.568851:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:11149:x1875740683440384:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 593us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.568858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1788846002.573200:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846002.573290:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683440640 00000100:00100000:1.0:1788846002.573301:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683440640 00000100:00100000:1.0:1788846002.573359:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1788846002.573370:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:11149:x1875740683440640:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1788846002.573640:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:11149:x1875740683440640:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 271us (450us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788846002.573648:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1788846002.622224:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846002.622509:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683440896 00000100:00100000:0.0:1788846002.622546:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683440896 00000100:00100000:0.0:1788846002.622607:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:0.0:1788846002.622627:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:11152:x1875740683440896:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846002.622658:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846002.622679:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138271d8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175456f expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622772:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622787:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622797:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622807:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622814:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622820:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622928:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622936:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.622942:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846002.622951:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788846002.623021:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623029:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623041:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623047:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846002.623051:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623058:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623069:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846002.623072:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846002.623076:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623083:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271d92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623095:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623101:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623106:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623111:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846002.623113:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623128:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623217:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:0.0:1788846002.623220:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846002.623224:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623229:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138271d99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623334:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138271d8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 36 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623349:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 35 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.623356:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846002.623358:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846002.623361:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356000, rc 0) 00000100:00100000:0.0:1788846002.623827:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:11152:x1875740683440896:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1209us (1611us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788846002.623835:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:0.0:1788846002.633067:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.633160:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683441024 00000100:00100000:2.0:1788846002.633178:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683441024 00000100:00100000:2.0:1788846002.633231:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:2.0:1788846002.633240:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:11152:x1875740683441024:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1788846002.633302:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633330:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633342:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633374:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633380:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633387:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633393:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846002.633397:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633501:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633513:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846002.633516:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846002.633743:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.633751:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271dae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846002.633852:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:11152:x1875740683441024:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 611us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.633867:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:2.0:1788846002.637012:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846002.637132:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683441280 00000100:00100000:1.0:1788846002.637143:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683441280 00000100:00100000:1.0:1788846002.637221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1788846002.637232:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:11152:x1875740683441280:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1788846002.637501:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+36:11152:x1875740683441280:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 271us (497us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788846002.637508:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1788846002.861850:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.861940:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683441536 00000100:00100000:2.0:1788846002.861950:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683441536 00000100:00100000:2.0:1788846002.862011:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:2.0:1788846002.862021:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+36:11183:x1875740683441536:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1788846002.862047:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846002.862066:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271db5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754576 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.862173:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271dbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.862188:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.862199:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846002.862211:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788846002.862322:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271db5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754576 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.862340:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271dbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754576 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.862349:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846002.862352:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846002.862367:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d000, rc 0) 00000100:00100000:2.0:1788846002.862428:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:11183:x1875740683441536:12345-192.168.203.20@tcp:101:cat.0 Request processed in 409us (587us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788846002.862437:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1788846002.868649:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846002.868696:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846002.868928:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683441792 00000100:00100000:1.0:1788846002.868938:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683441792 00000100:00100000:1.0:1788846002.868994:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1788846002.869004:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:11183:x1875740683441792:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:1.0:1788846002.869348:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:11183:x1875740683441792:12345-192.168.203.20@tcp:35:cat.0 Request processed in 344us (708us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788846002.869356:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1788846002.869434:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683441920 00000100:00100000:3.0:1788846002.869451:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683441920 00000100:00100000:3.0:1788846002.869510:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:3.0:1788846002.869544:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:2398:x1875740683441920:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846002.869555:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846002.869578:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271dbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754576 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.869594:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:3.0:1788846002.869599:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846002.869620:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:2398:x1875740683441920:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 103us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846002.869626:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1788846002.934687:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846002.934792:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683442176 00000100:00100000:3.0:1788846002.934805:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683442176 00000100:00100000:3.0:1788846002.934881:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1788846002.934892:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:11189:x1875740683442176:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:3.0:1788846002.934926:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846002.934930:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788846002.934975:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271d22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175454c expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.935003:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846002.935009:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846002.935025:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271dca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175457d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.935171:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.935205:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 38 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.935214:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.935265:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 38 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846002.935281:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 38 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846002.935298:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343ad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875740702402176:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846002.935431:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846002.937424:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343ad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875740702402176:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846002.937464:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846002.938645:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846002.938776:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683442304 00000100:00100000:1.0:1788846002.938787:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683442304 00010000:00010000:1.0:1788846002.938833:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 39 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846002.938883:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:1.0:1788846002.938894:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:2398:x1875740683442304:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846002.938912:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846002.938920:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 39 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.938934:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 39 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.938971:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271da0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175456f expref: 39 pid: 7876 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.939005:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:1.0:1788846002.939010:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.939021:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.939030:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846002.939067:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846002.939149:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:2398:x1875740683442304:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 256us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846002.939157:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00010000:00010000:0.0:1788846002.939816:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.939827:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846002.939861:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788846002.940179:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138271dca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.940202:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846002.940211:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846002.940213:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788846002.940216:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065a00, rc 0) 00000100:00100000:0.0:1788846002.940281:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:11189:x1875740683442176:12345-192.168.203.20@tcp:101:dd.0 Request processed in 5390us (5608us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788846002.940290:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:0.0:1788846002.945025:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.945292:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683442432 00000100:00100000:2.0:1788846002.945305:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683442432 00000100:00100000:2.0:1788846002.945378:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1788846002.945391:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:11189:x1875740683442432:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:2.0:1788846002.945425:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846002.945453:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ddf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754584 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.945497:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.945515:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.945575:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.945731:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ddf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 40 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.945752:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 39 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.945761:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846002.945764:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846002.945774:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d600, rc 0) 00000100:00100000:2.0:1788846002.945850:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:11189:x1875740683442432:12345-192.168.203.20@tcp:101:dd.0 Request processed in 462us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846002.945859:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:1.0:1788846002.954203:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846002.954284:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683442688 00000100:00100000:2.0:1788846002.954298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683442688 00000100:00100000:2.0:1788846002.954450:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:2.0:1788846002.954463:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:11189:x1875740683442688:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:2.0:1788846002.954792:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.954820:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.954833:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846002.954883:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788846002.954907:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036c94136 reply state 00000000e1883f4e transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.954922:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846002.954930:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846002.954934:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846002.954938:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846002.955071:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:11189:x1875740683442688:12345-192.168.203.20@tcp:36:dd.0 Request processed in 608us (1774us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788846002.955078:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000020:00080000:2.0:1788846002.955084:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788846003.002010:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702402304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846003.002131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846003.002653:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702402304 00000100:00100000:2.0:1788846003.002664:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702402304 00000100:00100000:2.0:1788846003.002772:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788846003.002784:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f47a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702402304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846003.002827:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788846003.002917:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f47a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702402304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846003.002926:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788846003.003015:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702402304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788846003.003386:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846003.177127:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846003.177342:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683442816 00000100:00100000:0.0:1788846003.177356:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683442816 00000100:00100000:0.0:1788846003.177466:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:0.0:1788846003.177478:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:11204:x1875740683442816:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:0.0:1788846003.177596:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846003.177625:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271df4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175458b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177717:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177734:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177748:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177760:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177768:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177775:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177863:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177875:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.177884:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.178133:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.178172:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 43 pid: 6515 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846003.178189:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f455f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875740702402432:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846003.178312:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450e57a80 going to sleep for 11 seconds 00000100:00080000:3.0:1788846003.181416:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846003.181990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.182306:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683443072 00000100:00100000:2.0:1788846003.182319:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683443072 00000100:00100000:2.0:1788846003.182401:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1788846003.182413:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+44:6166:x1875740683443072:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788846003.187453:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f455f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875740702402432:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846003.187500:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846003.188958:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+45:6166:x1875740683443072:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 6535us (6966us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788846003.188974:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:1.0:1788846003.196199:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.196333:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683443200 00000100:00100000:2.0:1788846003.196348:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683443200 00010000:00010000:2.0:1788846003.196949:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 45 pid: 6515 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846003.197129:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1788846003.197145:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+45:2398:x1875740683443200:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846003.197175:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846003.197184:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 45 pid: 6515 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.197201:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 45 pid: 6515 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.197254:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138271dd1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175457d expref: 45 pid: 6515 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.197277:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846003.197283:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.197294:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.197301:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.197337:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846003.197428:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+44:2398:x1875740683443200:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 287us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846003.197437:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00010000:00010000:0.0:1788846003.199306:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199325:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846003.199416:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788846003.199422:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846003.199483:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199503:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199516:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199553:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199583:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199591:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846003.199596:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199605:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199625:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846003.199629:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846003.199636:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199642:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271dfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199663:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199669:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199676:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199681:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846003.199684:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199701:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199713:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:0.0:1788846003.199715:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846003.199718:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199725:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199781:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271df4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175458b expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199797:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175458b expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.199805:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846003.199807:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846003.199809:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357200, rc 0) 00000100:00100000:0.0:1788846003.199905:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:11204:x1875740683442816:12345-192.168.203.20@tcp:101:stat.0 Request processed in 22428us (22794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846003.199916:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1788846003.286961:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846003.287135:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683443456 00000100:00100000:0.0:1788846003.287149:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683443456 00000100:00100000:0.0:1788846003.287240:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1788846003.287253:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:11210:x1875740683443456:12345-192.168.203.20@tcp:36:truncate.0 00010000:00010000:0.0:1788846003.287354:0:7876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846003.287390:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175458b expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.287415:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846003.287420:0:7876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846003.287712:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.287728:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.287738:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846003.287785:0:7876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788846003.287808:0:7876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1ed47c9 reply state 00000000e96e4727 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.287821:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.287827:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846003.287830:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846003.287833:0:7876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846003.287981:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+45:11210:x1875740683443456:12345-192.168.203.20@tcp:36:truncate.0 Request processed in 730us (1034us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788846003.287990:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000020:00080000:0.0:1788846003.287996:0:7876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788846003.503956:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846003.504203:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683443584 00000100:00100000:0.0:1788846003.504238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683443584 00000100:00100000:0.0:1788846003.504318:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:0.0:1788846003.504331:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+45:11224:x1875740683443584:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:0.0:1788846003.504365:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846003.504409:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754592 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504498:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504517:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504599:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504613:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504622:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504629:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504720:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504731:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504738:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846003.504801:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788846003.504806:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846003.504832:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504847:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504855:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504862:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504869:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504875:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846003.504881:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504889:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504903:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846003.504907:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846003.504911:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504917:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271e1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504945:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504952:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504958:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504964:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846003.504967:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504973:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504983:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:0.0:1788846003.504985:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846003.504988:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.504993:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271e25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.505027:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.505042:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.505063:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846003.505066:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846003.505069:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357600, rc 0) 00000100:00100000:0.0:1788846003.505156:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+46:11224:x1875740683443584:12345-192.168.203.20@tcp:101:stat.0 Request processed in 827us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846003.505175:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:3.0:1788846003.609404:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846003.609720:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683443840 00000100:00100000:0.0:1788846003.609735:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683443840 00000100:00100000:0.0:1788846003.609824:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:0.0:1788846003.609836:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+46:11234:x1875740683443840:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846003.609864:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846003.609889:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754599 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846003.610026:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788846003.610187:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754599 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.610205:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:0.0:1788846003.610209:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846003.610215:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271e33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754599 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.610244:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357200, rc 0) 00000100:00100000:0.0:1788846003.610330:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:11234:x1875740683443840:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 495us (941us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788846003.610361:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:1.0:1788846003.619601:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.620219:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683444096 00000100:00100000:2.0:1788846003.620234:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683444096 00000100:00100000:2.0:1788846003.620314:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1788846003.620326:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:11234:x1875740683444096:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846003.620700:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+48:11234:x1875740683444096:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 375us (1186us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788846003.620709:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:3.0:1788846003.714921:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846003.715237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683444352 00000100:00100000:1.0:1788846003.715252:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683444352 00000100:00100000:1.0:1788846003.715465:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1788846003.715479:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+48:11240:x1875740683444352:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1788846003.715513:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846003.715627:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271e41 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545a0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.715798:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.715818:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.715828:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.715872:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.715890:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 49 pid: 6517 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846003.715908:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702402560:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846003.716289:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484df180 going to sleep for 11 seconds 00000100:00100000:1.0:1788846003.721303:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702402560:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846003.721347:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846003.726264:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846003.727484:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683444480 00000100:00100000:0.0:1788846003.727500:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683444480 00010000:00010000:0.0:1788846003.727623:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 50 pid: 6517 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846003.727677:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:0.0:1788846003.727828:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+50:2398:x1875740683444480:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846003.727853:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846003.727861:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 50 pid: 6517 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.727878:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 50 pid: 6517 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.727907:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271e2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754592 expref: 50 pid: 6517 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.727928:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846003.727935:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.727948:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.727958:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846003.728076:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846003.728182:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+49:2398:x1875740683444480:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 493us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846003.728191:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00010000:00010000:1.0:1788846003.730323:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.730345:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846003.730377:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788846003.733426:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271e41 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.733462:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 49 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.733472:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:1.0:1788846003.733475:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788846003.733479:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3400, rc 0) 00000100:00100000:1.0:1788846003.733599:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+49:11240:x1875740683444352:12345-192.168.203.20@tcp:101:bash.0 Request processed in 18122us (19481us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788846003.733610:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:3.0:1788846003.738328:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.738715:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683444736 00000100:00100000:2.0:1788846003.738730:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683444736 00000100:00100000:2.0:1788846003.738815:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1788846003.738848:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+49:11240:x1875740683444736:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:2.0:1788846003.739183:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.739207:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.739223:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846003.739280:0:12145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788846003.739308:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066638698 reply state 00000000faccf699 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.739323:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.739332:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846003.739335:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846003.739339:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846003.739492:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+52:11240:x1875740683444736:12345-192.168.203.20@tcp:36:bash.0 Request processed in 645us (1178us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788846003.739501:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000020:00080000:2.0:1788846003.739507:0:12145:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788846003.748442:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.749130:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683444864 00000100:00100000:2.0:1788846003.749145:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683444864 00000100:00100000:2.0:1788846003.749244:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:2.0:1788846003.749256:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+52:11240:x1875740683444864:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846003.749287:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846003.749314:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271e5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545a7 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.749479:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.749498:0:7876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.749509:0:7876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.749607:0:7876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.749622:0:7876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 53 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846003.749638:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343652a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702402688:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846003.749760:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e44505d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846003.753271:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846003.753419:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683444992 00000100:00100000:1.0:1788846003.753432:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683444992 00010000:00010000:1.0:1788846003.753484:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 54 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846003.753585:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1788846003.753597:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:2398:x1875740683444992:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846003.753617:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846003.753625:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 54 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.753639:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 54 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.753668:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:1.0:1788846003.753680:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.753692:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.753700:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.753724:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846003.753790:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:2398:x1875740683444992:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 195us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846003.753799:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00010000:00010000:2.0:1788846003.754291:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271e48 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a0 expref: 53 pid: 6516 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846003.754314:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343652a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702402688:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846003.754342:0:7876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.754351:0:7876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.754372:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846003.754440:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788846003.754445:0:7876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846003.754469:0:7876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.754504:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138271e5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a7 expref: 53 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.754809:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a7 expref: 52 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.754819:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846003.754822:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846003.754825:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031800, rc 0) 00000100:00100000:2.0:1788846003.755011:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+52:11240:x1875740683444864:12345-192.168.203.20@tcp:101:bash.0 Request processed in 5756us (6583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846003.755020:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:3.0:1788846003.760004:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.760281:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683445248 00000100:00100000:2.0:1788846003.760295:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683445248 00000100:00100000:2.0:1788846003.760374:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1788846003.760386:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+52:11240:x1875740683445248:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1788846003.760718:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+53:11240:x1875740683445248:12345-192.168.203.20@tcp:35:bash.0 Request processed in 333us (728us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788846003.760727:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1788846003.851332:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846003.857286:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683445504 00000100:00100000:1.0:1788846003.857309:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683445504 00000100:00100000:1.0:1788846003.857444:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:1.0:1788846003.857457:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+53:11250:x1875740683445504:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846003.857493:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846003.857539:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271e6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846003.857679:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788846003.857814:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271e6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ae expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.857838:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:1.0:1788846003.857841:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846003.857847:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271e6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ae expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.857885:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3a00, rc 0) 00000100:00100000:1.0:1788846003.857976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:11250:x1875740683445504:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 521us (6658us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788846003.857985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1788846003.863248:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.863402:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683445632 00000100:00100000:2.0:1788846003.863418:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683445632 00000100:00100000:2.0:1788846003.863502:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:2.0:1788846003.863516:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:11250:x1875740683445632:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1788846003.863701:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.863727:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.863744:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.863758:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.863767:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.863773:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.863894:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.863906:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.863914:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846003.863991:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864032:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864040:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864047:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864054:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846003.864059:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864068:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864083:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846003.864086:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846003.864091:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864098:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864115:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864121:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864127:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864139:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846003.864142:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864148:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864167:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:2.0:1788846003.864170:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846003.864173:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864179:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864191:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864196:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864202:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864207:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846003.864210:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864215:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864234:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846003.864236:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846003.864240:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.864247:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846003.864357:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:11250:x1875740683445632:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 843us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846003.864366:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:3.0:1788846003.868763:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.868864:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683445888 00000100:00100000:2.0:1788846003.868877:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683445888 00000100:00100000:2.0:1788846003.868949:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:2.0:1788846003.868960:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:11250:x1875740683445888:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846003.869252:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:11250:x1875740683445888:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 292us (732us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788846003.869261:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:1.0:1788846003.923679:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846003.923872:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683446144 00000100:00100000:2.0:1788846003.923885:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683446144 00000100:00100000:2.0:1788846003.923966:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:2.0:1788846003.923978:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:11253:x1875740683446144:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846003.924010:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846003.924036:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545b5 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924145:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924193:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924209:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924224:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924231:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924238:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924398:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138271ea3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924409:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138271ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924417:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138271ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846003.924428:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788846003.924567:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924576:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924583:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924597:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846003.924603:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924612:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924627:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846003.924631:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846003.924637:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924644:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d56138271e95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924661:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924668:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924675:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924680:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846003.924683:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924690:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924713:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:2.0:1788846003.924716:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846003.924720:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924726:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271e9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924776:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271e8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545b5 expref: 58 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924794:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138271ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545b5 expref: 57 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846003.924802:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846003.924805:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846003.924807:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031c00, rc 0) 00000100:00100000:2.0:1788846003.924895:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:11253:x1875740683446144:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 919us (1230us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788846003.924904:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:0.0:1788846003.928482:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846003.928585:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846003.928682:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683446272 00000100:00100000:1.0:1788846003.928695:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683446272 00000100:00100000:1.0:1788846003.928766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:1.0:1788846003.928778:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:11253:x1875740683446272:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1788846003.928871:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.928893:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.928907:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.928950:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.928958:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.928964:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.928971:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846003.928996:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.929005:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.929019:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:1.0:1788846003.929023:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846003.929028:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846003.929034:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271eb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846003.929376:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683446400 00000100:00100000:3.0:1788846003.929383:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683446400 00000100:00100000:3.0:1788846003.929479:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1788846003.929488:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:2398:x1875740683446400:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846003.929502:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846003.929545:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138271ea3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545b5 expref: 58 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846003.929564:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:3.0:1788846003.929568:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846003.929591:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:11253:x1875740683446272:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 813us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846003.929601:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:3.0:1788846003.929607:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:2398:x1875740683446400:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 119us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846003.929615:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1788846003.940944:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846003.944749:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683446656 00000100:00100000:1.0:1788846003.944771:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683446656 00000100:00100000:1.0:1788846003.944954:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1788846003.944969:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+56:11253:x1875740683446656:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1788846003.945365:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:11253:x1875740683446656:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 398us (4434us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788846003.945374:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00010000:00010000:3.0:1788846004.025871:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846004.109385:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.109585:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683446912 00000100:00100000:2.0:1788846004.109600:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683446912 00000100:00100000:2.0:1788846004.109671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:2.0:1788846004.109683:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:11271:x1875740683446912:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1788846004.109715:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846004.109741:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271eb8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545bc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.109893:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271ebf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.109913:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271ebf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.109929:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271ebf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846004.109942:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788846004.110242:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271eb8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545bc expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.110275:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271ebf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545bc expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.110286:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846004.110289:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788846004.110292:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031a00, rc 0) 00000100:00100000:2.0:1788846004.110493:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:11271:x1875740683446912:12345-192.168.203.20@tcp:101:cat.0 Request processed in 811us (1123us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788846004.110501:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:0.0:1788846004.144407:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.144834:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683447040 00000100:00100000:3.0:1788846004.144857:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683447040 00000100:00100000:3.0:1788846004.144944:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:3.0:1788846004.144957:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:11272:x1875740683447040:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846004.144998:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846004.145285:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.145369:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ed4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.145403:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.145426:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846004.145864:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788846004.145872:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846004.145900:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.145936:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545c3 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.145959:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545c3 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.145980:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846004.145983:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846004.145987:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846004.146501:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343ad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11272:x1875740683447040:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1542us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846004.146511:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:3.0:1788846004.154321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.154477:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683447424 00000100:00100000:1.0:1788846004.154492:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683447424 00000100:00100000:1.0:1788846004.154612:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788846004.154626:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11272:x1875740683447424:12345-192.168.203.20@tcp:35:lfs.0 00000001:00080000:1.0:1788846004.154915:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967352 00000100:00100000:1.0:1788846004.155077:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11272:x1875740683447424:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 452us (771us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788846004.155087:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000020:00080000:1.0:1788846004.155093:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788846004.161944:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.162237:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683447552 00000100:00100000:3.0:1788846004.162251:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683447552 00000100:00100000:3.0:1788846004.162339:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1788846004.162351:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11272:x1875740683447552:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:3.0:1788846004.162395:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788846004.162438:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271e64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545a7 expref: 62 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.162968:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271ebf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545bc expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.162982:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138271d61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754561 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.162993:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:3.0:1788846004.162999:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846004.163117:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:11272:x1875740683447552:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 768us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846004.163131:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1788846004.167683:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.167890:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683447680 00000100:00100000:1.0:1788846004.167904:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683447680 00000100:00100000:1.0:1788846004.167982:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:1.0:1788846004.167994:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:11272:x1875740683447680:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:1.0:1788846004.168189:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.168211:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.168226:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788846004.168554:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846004.170304:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788846004.170425:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788846004.171567:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:11272:x1875740683447680:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 3561us (3884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846004.171777:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:2.0:1788846004.201843:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.202715:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683447808 00000100:00100000:0.0:1788846004.202732:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683447808 00000100:00100000:0.0:1788846004.202821:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:0.0:1788846004.202833:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:11274:x1875740683447808:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846004.202861:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846004.202887:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271ee2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545ca expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.202979:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.202997:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203012:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203050:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203059:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203066:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203319:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203331:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203339:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846004.203394:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788846004.203399:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846004.203423:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203436:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203445:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203452:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203473:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203481:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.203485:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203495:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203510:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846004.203513:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.203518:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.203575:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271ee9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204232:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204239:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204246:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204251:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.204254:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204275:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204288:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:0.0:1788846004.204290:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.204294:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204299:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271ef0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204345:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271ee2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204360:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.204367:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846004.204369:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846004.204372:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357200, rc 0) 00000100:00100000:0.0:1788846004.204469:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11274:x1875740683447808:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1637us (2637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.204478:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00000040:00080000:3.0:1788846004.347553:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788846004.347564:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846004.347627:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788846004.347638:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788846004.347819:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f537100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702402816:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788846004.347955:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541e40 going to sleep for 11 seconds 00000040:00080000:3.0:1788846004.353932:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788846004.364988:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.365081:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683447936 00000100:00100000:0.0:1788846004.365095:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683447936 00000100:00100000:1.0:1788846004.365119:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f537100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702402816:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788846004.365185:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:0.0:1788846004.365198:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11285:x1875740683447936:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788846004.365262:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788846004.365467:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11285:x1875740683447936:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 266us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.365477:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:2.0:1788846004.379174:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.381117:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683448064 00000100:00100000:0.0:1788846004.381131:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683448064 00000100:00100000:0.0:1788846004.381203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:0.0:1788846004.381214:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11285:x1875740683448064:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788846004.381282:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381298:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381310:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381324:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381331:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381337:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381362:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381371:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381389:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846004.381433:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788846004.381438:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846004.381451:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381463:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381480:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381487:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381492:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.381497:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381508:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381534:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:0.0:1788846004.381537:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.381542:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381548:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138271efe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381572:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381578:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381583:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381588:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.381591:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381596:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381605:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff90e4514bd700) 00010000:00010000:0.0:1788846004.381608:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.381610:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381969:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f05 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381991:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.381997:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.382003:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.382015:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.382019:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.382025:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.382033:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846004.382036:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.382039:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.382045:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846004.382136:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11285:x1875740683448064:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 921us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.382144:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:1.0:1788846004.387563:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.387687:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683448320 00000100:00100000:0.0:1788846004.387698:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683448320 00000100:00100000:0.0:1788846004.387760:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:0.0:1788846004.387770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11285:x1875740683448320:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846004.387788:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846004.387804:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.387902:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.387932:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.387944:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846004.387961:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788846004.388032:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388039:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388045:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388051:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.388055:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388061:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388072:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846004.388075:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846004.388079:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388084:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388117:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f13 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545d1 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388132:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:0.0:1788846004.388134:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846004.388138:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545d1 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.388146:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356000, rc 0) 00000100:00100000:0.0:1788846004.388255:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11285:x1875740683448320:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 488us (699us total) trans 4294967354 rc 301/301 00000100:00100000:0.0:1788846004.388262:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:1.0:1788846004.398677:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.398872:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683448448 00000100:00100000:2.0:1788846004.398882:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683448448 00000100:00100000:2.0:1788846004.398952:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:2.0:1788846004.398975:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11285:x1875740683448448:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788846004.399008:0:7876:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788846004.399120:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11285:x1875740683448448:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 146us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.399129:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:3.0:1788846004.405191:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.406413:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683448704 00000100:00100000:1.0:1788846004.406428:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683448704 00000100:00100000:1.0:1788846004.406511:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:0.0:1788846004.406829:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11285:x1875740683448704:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846004.406849:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846004.406852:0:12145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788846004.406876:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138271ed4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545c3 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.406895:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846004.406900:0:12145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846004.406912:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f28 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545d8 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788846004.407355:0:12145:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788846004.407809:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.407823:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.407842:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.407899:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f28 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545d8 expref: 63 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.407915:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545d8 expref: 62 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.407924:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd700) 00010000:00010000:0.0:1788846004.407927:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846004.407930:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356a00, rc 0) 00000100:00100000:0.0:1788846004.408047:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11285:x1875740683448704:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1309us (2871us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788846004.408055:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:2.0:1788846004.419584:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.420711:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683448960 00000100:00100000:0.0:1788846004.420727:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683448960 00000100:00100000:0.0:1788846004.420800:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:0.0:1788846004.420811:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11285:x1875740683448960:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788846004.420863:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846004.420890:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545d8 expref: 62 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.420908:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd700) 00010000:00010000:0.0:1788846004.420919:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846004.420939:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.420966:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.420976:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421039:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421047:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421053:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421094:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421101:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421109:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421115:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.421119:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421127:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421136:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846004.421144:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.421149:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421166:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421177:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421184:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421190:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421195:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.421198:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421204:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421212:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x49f85106 (ffff90e4514bd800) 00010000:00010000:0.0:1788846004.421215:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.421218:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.421223:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f44 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x49f85106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846004.421369:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11285:x1875740683448960:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 559us (1798us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788846004.421381:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:1.0:1788846004.430054:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.430654:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683449088 00000100:00100000:0.0:1788846004.430714:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683449088 00000100:00100000:0.0:1788846004.430788:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:0.0:1788846004.430798:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11285:x1875740683449088:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846004.430817:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846004.430836:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545df expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.430868:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.430882:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.430893:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.430997:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d56138271f4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 63 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.431014:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 62 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.431023:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:0.0:1788846004.431026:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846004.431029:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356000, rc 0) 00000100:00100000:0.0:1788846004.431092:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11285:x1875740683449088:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 295us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.431106:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:0.0:1788846004.435560:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.435636:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683449344 00000100:00100000:2.0:1788846004.435645:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683449344 00000100:00100000:2.0:1788846004.435726:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:2.0:1788846004.435736:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11285:x1875740683449344:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788846004.435812:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.435828:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.435840:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846004.435982:0:12145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788846004.435990:0:12145:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388473469379ns, next at 389473467653ns, rc = 0 00000004:00010000:2.0:1788846004.436049:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000326c48fc reply state 0000000033bf4591 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.436062:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.436068:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:2.0:1788846004.436071:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788846004.436078:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846004.436176:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:11285:x1875740683449344:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 441us (622us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788846004.436183:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:1.0:1788846004.441030:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.441118:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683449472 00000100:00100000:3.0:1788846004.441132:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683449472 00000100:00100000:3.0:1788846004.441217:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:3.0:1788846004.441229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:11285:x1875740683449472:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846004.441272:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846004.441300:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.441375:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.441396:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.441419:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:3.0:1788846004.441423:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846004.441427:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065e00, rc 0) 00000100:00100000:3.0:1788846004.441508:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:11285:x1875740683449472:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 281us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846004.441516:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:1.0:1788846004.456502:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.456635:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683449600 00000100:00100000:2.0:1788846004.456651:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683449600 00000100:00100000:2.0:1788846004.456716:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:2.0:1788846004.456725:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875740683449600:12345-192.168.203.20@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788846004.456772:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp t0 exp 0000000000000000 cur 388 last 0 00000020:00000080:2.0:1788846004.456832:0:8432:0:(genops.c:1385:class_connect()) connect: client 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635, cookie 0x21b4d56138271f67 00002000:00100000:2.0:1788846004.456843:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635/ffff90e34440a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788846004.456858:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788846004.456923:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788846004.456954:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90e344408800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846004.457017:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2397:x1875740683449600:12345-192.168.203.20@tcp:8:lhsmtool_posix.0 Request processed in 291us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.457025:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:2.0:1788846004.462606:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.462718:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683449728 00000100:00100000:3.0:1788846004.462732:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683449728 00000100:00100000:3.0:1788846004.462818:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1788846004.462833:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:0:x1875740683449728:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788846004.463199:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788846004.464510:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1788846004.464729:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000100:00100000:2.0:1788846004.470031:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:0:x1875740683449728:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 7180us (7417us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788846004.470047:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1788846004.487681:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.487806:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683449984 00000100:00100000:2.0:1788846004.487821:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683449984 00000100:00100000:2.0:1788846004.487958:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1788846004.487972:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:11285:x1875740683449984:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788846004.488860:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:11285:x1875740683449984:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 887us (1189us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788846004.488890:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1788846004.493975:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.494348:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683450240 00000100:00100000:2.0:1788846004.494362:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683450240 00000100:00100000:2.0:1788846004.494432:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:2.0:1788846004.494444:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:11285:x1875740683450240:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788846004.495822:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:11285:x1875740683450240:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 1365us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.495838:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:2.0:1788846004.499367:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.499490:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683450368 00000100:00100000:0.0:1788846004.499504:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683450368 00000100:00100000:0.0:1788846004.500847:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1788846004.500865:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:11285:x1875740683450368:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846004.500891:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846004.500917:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545ed expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.501010:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.501858:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.501874:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846004.501944:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846004.501971:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.503466:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138271f6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ed expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.503512:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ed expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.503570:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:0.0:1788846004.503573:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788846004.504089:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357600, rc 0) 00000100:00100000:0.0:1788846004.504295:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:11285:x1875740683450368:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3431us (4938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.504306:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:0.0:1788846004.507908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.508246:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683450496 00000100:00100000:2.0:1788846004.508259:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683450496 00000100:00100000:2.0:1788846004.508329:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:2.0:1788846004.508340:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683450496:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846004.508364:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846004.508390:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545f4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846004.508420:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9fb4, blocks: 0x0 00010000:00010000:2.0:1788846004.508449:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:2.0:1788846004.508454:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846004.508466:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.508490:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.508559:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031c00, rc 0) 00000100:00100000:2.0:1788846004.508637:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2400:x1875740683450496:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 299us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.508645:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1788846004.513297:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.513466:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683450752 00000100:00100000:0.0:1788846004.513480:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683450752 00000100:00100000:0.0:1788846004.513583:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:0.0:1788846004.513596:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:11285:x1875740683450752:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788846004.513741:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:11285:x1875740683450752:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 148us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.513750:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:0.0:1788846004.527797:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.527877:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683450880 00000100:00100000:1.0:1788846004.527890:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683450880 00000100:00100000:1.0:1788846004.527957:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1788846004.527967:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:11285:x1875740683450880:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788846004.527989:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846004.528023:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217545fb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.528063:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.528073:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846004.528079:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846004.528084:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.528132:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.528178:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 7 pid: 8432 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846004.528195:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875740702402944:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846004.528293:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484df180 going to sleep for 11 seconds 00000100:00100000:0.0:1788846004.539274:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.539385:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875740702402944:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846004.539430:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.539458:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3000, rc 0) 00000100:00100000:3.0:1788846004.539721:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683451008 00000100:00100000:3.0:1788846004.539731:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683451008 00010000:00010000:3.0:1788846004.539778:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 8 pid: 8432 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.539859:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1788846004.539904:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2399:x1875740683451008:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846004.539921:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846004.539947:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 8 pid: 8432 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.539963:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 8 pid: 8432 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.539991:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138271f7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545f4 expref: 8 pid: 8432 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.540023:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846004.540028:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846004.540039:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.540050:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.540091:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.540108:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875740702403072:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846004.540285:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:11285:x1875740683450880:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 12317us (12499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846004.540295:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:3.0:1788846004.540583:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541300 going to sleep for 11 seconds 00000100:00100000:3.0:1788846004.548992:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875740702403072:192.168.203.20@tcp:105: 00010000:00010000:3.0:1788846004.549054:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846004.549185:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683451008:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 9281us (9922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846004.549199:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1788846004.554271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.554397:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683451136 00000100:00100000:3.0:1788846004.554410:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683451136 00002000:00100000:3.0:1788846004.554467:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90e46f3efb80 x1875740683451136/t0(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:355/0 lens 504/0 e 0 to 0 dl 1788846015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788846004.554480:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e46f3efb80 with x1875740683451136 ext(0->8) 00002000:00010000:3.0:1788846004.554487:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e46f3efb80 00000100:00100000:1.0:1788846004.554767:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:1.0:1788846004.554781:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683451136:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788846004.562096:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2399:x1875740683451136:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 7293us (7813us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788846004.562134:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00002000:00100000:2.0:1788846004.562161:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff90e46f3efb80 x1875740683451136/t4294967303(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:355/0 lens 504/448 e 0 to 0 dl 1788846015 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788846004.562174:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e46f3efb80 with x1875740683451136 ext(0->8) 00002000:00010000:2.0:1788846004.562182:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e46f3efb80 00000100:00100000:0.0:1788846004.567011:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.567340:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683451264 00000100:00100000:1.0:1788846004.567354:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683451264 00000100:00100000:1.0:1788846004.567434:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:1.0:1788846004.567445:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:11285:x1875740683451264:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788846004.578116:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:2.0:1788846004.578211:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1788846004.578234:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578250:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578259:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578292:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.578298:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578306:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578329:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90e451775d00) 00010000:00010000:0.0:1788846004.578332:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.578338:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578344:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138271c9d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578377:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578383:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578388:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578393:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.578395:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578400:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578418:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846004.578420:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.578423:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578428:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2c00/0x21b4d56138271ca4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578444:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578449:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.578455:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579806:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.579814:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579825:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579845:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e451775800) 00010000:00010000:0.0:1788846004.579849:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.579854:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579862:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138271ce3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579908:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579916:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579922:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579928:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.579931:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579938:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579947:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846004.579949:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.579953:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579958:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138271ded lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579969:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579975:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579980:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.579991:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.579994:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580000:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580008:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846004.580010:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.580013:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580019:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271e10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580034:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580040:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580046:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580050:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42dc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.580053:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580059:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580079:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846004.580081:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846004.580084:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580090:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138271e56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580102:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580109:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580114:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580119:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846004.580122:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580128:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580136:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:0.0:1788846004.580138:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788846004.580141:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.580147:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d56138271f59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.580902:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846004.580938:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702403200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788846004.583199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846004.583304:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702403200 00000100:00100000:3.0:1788846004.583316:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702403200 00000100:00100000:3.0:1788846004.583396:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788846004.583408:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702403200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788846004.584973:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788846004.584985:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788846004 00002000:00010000:3.0:1788846004.584989:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788846004.584992:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788846004 -> 1788846004 00002000:00010000:3.0:1788846004.584994:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788846004.585614:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702403200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2202us (2561us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788846004.585627:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:2.0:1788846004.585759:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788846004.585788:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e341da3e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788846004.585792:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e4452ce500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e341da3000 00000020:00080000:2.0:1788846004.585796:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e4452ce800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e461dbaa00 00000100:00080000:3.0:1788846004.586275:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788846004.586322:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702403328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788846004.586386:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846004.587880:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702403328 00000100:00100000:2.0:1788846004.587897:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702403328 00000100:00100000:2.0:1788846004.588099:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788846004.588113:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702403328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788846004.588163:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788846004.588204:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f9fb2, atime: 0x6a9f9fb2, ctime: 0x6a9f9fb2, blocks: 0x8 00010000:00010000:2.0:1788846004.588228:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.588248:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=388s v=(0 0) 00010000:00010000:2.0:1788846004.588253:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846004.588260:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.588280:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.588292:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.588301:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.588323:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788846004.589096:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875740702403328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 984us (2705us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788846004.589108:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788846004.589144:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846004.589164:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.589176:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846004.589181:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.589205:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.589228:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.589236:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d56138271f8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.589262:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846004.589264:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846004.589266:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846004.589950:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:11285:x1875740683451264:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 22451us (22995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.589963:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 90 00000020:00080000:2.0:1788846004.589997:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788846004.590228:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:3.0:1788846004.590494:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788846004.590886:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e343b2d180/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788846004.590906:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702403328:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788846004.590929:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e47f534380/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788846004.590934:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702403200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788846004.598292:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.599742:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683451392 00000100:00100000:0.0:1788846004.599761:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683451392 00000100:00100000:0.0:1788846004.599880:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:0.0:1788846004.599894:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683451392:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788846004.609175:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788846004.609189:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1788846004.609395:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683451392:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 9491us (11103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.609411:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:0.0:1788846004.619514:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.621407:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683451648 00000100:00100000:1.0:1788846004.621418:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683451648 00000100:00100000:1.0:1788846004.621508:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1788846004.621541:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:11285:x1875740683451648:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788846004.621597:0:12145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846004.621623:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138271f75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ed expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.621641:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:1.0:1788846004.621647:0:12145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788846004.621676:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.621689:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.621698:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788846004.621814:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001be69b26 reply state 000000001fef11aa transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.621839:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.621858:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:1.0:1788846004.621861:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788846004.621864:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788846004.621971:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:11285:x1875740683451648:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 445us (2457us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1788846004.621979:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1788846004.625199:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.625272:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683451776 00000100:00100000:2.0:1788846004.625288:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683451776 00000100:00100000:2.0:1788846004.625367:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1788846004.625377:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683451776:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788846004.625572:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788846004.625576:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788846004 -> 1788846004 00002000:00010000:2.0:1788846004.625579:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788846002 00002000:00010000:2.0:1788846004.625581:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788846004 -> 1788846004 00002000:00010000:2.0:1788846004.625606:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788846004.625685:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683451776:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 309us (502us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788846004.625692:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:3.0:1788846004.634947:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846004.635116:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683452032 00000100:00100000:0.0:1788846004.635140:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683452032 00000100:00100000:3.0:1788846004.635304:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:3.0:1788846004.635322:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:11285:x1875740683452032:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788846004.635418:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.635440:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 15 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.635451:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.635497:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 15 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.635514:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 15 pid: 7876 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.635555:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f536300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702403456:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846004.635731:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541300 going to sleep for 11 seconds 00000100:00100000:1.0:1788846004.642374:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f536300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702403456:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846004.642384:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1788846004.642421:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846004.642494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683452160 00000100:00100000:2.0:1788846004.642504:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683452160 00010000:00010000:2.0:1788846004.642595:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 16 pid: 7876 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846004.642634:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1788846004.642645:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:2399:x1875740683452160:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846004.642694:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846004.642703:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 16 pid: 7876 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.642718:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 16 pid: 7876 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.642747:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138271f52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545df expref: 16 pid: 7876 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.642766:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:2.0:1788846004.642771:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.642783:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.642803:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.642838:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846004.642901:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:2399:x1875740683452160:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 257us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.642910:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00010000:00010000:3.0:1788846004.643787:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.643801:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.643854:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.643871:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.643878:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.643885:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846004.643891:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.644179:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.644199:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:3.0:1788846004.644203:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788846004.644208:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.644215:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271f98 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.644317:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:11285:x1875740683452032:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 8997us (9380us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788846004.644329:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:3.0:1788846004.646104:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.648630:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683452288 00000100:00100000:1.0:1788846004.648650:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683452288 00000100:00100000:1.0:1788846004.648809:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1788846004.648823:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683452288:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788846004.648882:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.648911:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.648920:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846004.648925:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846004.648929:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.649052:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.649069:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 7 pid: 8430 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846004.649088:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1875740702403584:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846004.649211:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484df000 going to sleep for 11 seconds 00000100:00100000:3.0:1788846004.655679:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8906:1875740702403584:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846004.655720:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.656819:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846004.656956:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683452416 00000100:00100000:1.0:1788846004.656968:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683452416 00010000:00010000:1.0:1788846004.657015:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 8 pid: 8430 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846004.657060:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:1.0:1788846004.657071:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f537100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2399:x1875740683452416:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846004.657091:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846004.657120:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 8 pid: 8430 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.657136:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 8 pid: 8430 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.657180:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138271f83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545fb expref: 8 pid: 8430 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.657217:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846004.657235:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846004.657241:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.657252:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846004.657285:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846004.657349:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f537100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683452416:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 279us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846004.657358:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00010000:00010000:3.0:1788846004.658399:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.658416:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.658453:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.658464:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.658473:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.658481:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846004.658486:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.658497:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.658514:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.658556:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e951ed02/0x21b4d56138271f9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.660344:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683452288:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 11509us (14236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846004.660359:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:1.0:1788846004.669648:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.670197:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683452672 00000100:00100000:3.0:1788846004.670212:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683452672 00000100:00100000:3.0:1788846004.670292:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:3.0:1788846004.670307:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:11285:x1875740683452672:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788846004.670412:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.670434:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 14 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.670445:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.670512:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 14 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.670556:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 14 pid: 12145 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.670573:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344441880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702403712:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846004.670753:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846004.673463:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344441880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702403712:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846004.673506:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846004.676387:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846004.676671:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683452800 00000100:00100000:2.0:1788846004.676686:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683452800 00010000:00010000:2.0:1788846004.676741:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 15 pid: 12145 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846004.676782:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:2.0:1788846004.676793:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:2398:x1875740683452800:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846004.676813:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846004.676822:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 15 pid: 12145 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.676838:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 15 pid: 12145 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.676865:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138271de6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754584 expref: 15 pid: 12145 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.676886:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:2.0:1788846004.676893:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.676933:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.676942:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846004.676979:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846004.677053:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:2398:x1875740683452800:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 260us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.677062:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00010000:00010000:0.0:1788846004.677202:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.677212:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.677512:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.677556:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.677566:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.677613:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.677632:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 14 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846004.677649:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702403840:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846004.677717:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788846004.685212:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.685435:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683452928 00000100:00100000:3.0:1788846004.685449:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683452928 00010000:00010000:3.0:1788846004.685502:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 15 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.685586:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:3.0:1788846004.685602:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:2399:x1875740683452928:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846004.685620:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846004.685762:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 15 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.685780:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 15 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.685811:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:3.0:1788846004.685818:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.685830:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.685838:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.685863:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846004.685932:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:2399:x1875740683452928:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 335us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846004.685940:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00010000:00010000:0.0:1788846004.687754:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138271f60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545e6 expref: 14 pid: 6516 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846004.687782:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702403840:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846004.687816:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.687827:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.687833:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846004.687992:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788846004.688163:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:0.0:1788846004.688211:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788846004.688398:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875740702403968:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788846004.688489:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846004.688636:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d196180 going to sleep for 11 seconds 00000100:00100000:2.0:1788846004.697738:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702403968 00000100:00100000:2.0:1788846004.697757:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702403968 00000100:00100000:2.0:1788846004.697841:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788846004.697853:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1875740702403968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788846004.698119:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1875740702403968:12345-0@lo:1000:mdt00_002.0 Request processed in 268us (9629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846004.698129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788846004.705546:0:6517:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788846004.705565:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e47f534380, transno 4294967304 00000100:00100000:0.0:1788846004.705602:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875740702403968:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788846004.705843:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:0.0:1788846004.705953:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875740702404096:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788846004.706048:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846004.706092:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846004.706203:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702404096 00000100:00100000:2.0:1788846004.706213:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702404096 00000100:00100000:2.0:1788846004.706300:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788846004.706311:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1875740702404096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788846004.706480:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6517:x1875740702404096:12345-0@lo:1000:mdt00_002.0 Request processed in 171us (432us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788846004.706488:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788846004.706583:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875740702404096:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788846004.706691:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706705:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706714:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706721:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846004.706727:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706736:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706755:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:3.0:1788846004.706759:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846004.706764:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706771:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138271fad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706813:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706820:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706827:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706853:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846004.706857:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706863:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706872:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:3.0:1788846004.706875:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846004.706878:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706883:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d56138271edb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706909:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706925:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706935:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706966:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.706983:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 17 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.707008:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344442300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702404224:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846004.707090:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846004.714546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.714607:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344442300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702404224:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846004.714648:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846004.714659:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683453056 00000100:00100000:0.0:1788846004.714669:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683453056 00010000:00010000:0.0:1788846004.714715:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 18 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846004.714760:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1788846004.714771:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:2398:x1875740683453056:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846004.714787:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846004.714795:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 18 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.714808:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 18 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.714835:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138271ef7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217545ca expref: 18 pid: 6517 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.714851:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:0.0:1788846004.714856:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.714878:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.714885:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.714908:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846004.714972:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:2398:x1875740683453056:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 202us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846004.714980:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00010000:00010000:3.0:1788846004.715193:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715202:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715217:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715224:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715232:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715239:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846004.715305:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715315:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715326:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:3.0:1788846004.715338:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846004.715344:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715350:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fb4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715364:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715371:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715377:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715383:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846004.715387:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715394:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715403:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e3437a7b00) 00010000:00010000:3.0:1788846004.715406:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788846004.715408:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.715415:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138271fa6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.715629:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:11285:x1875740683452672:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 45323us (45992us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788846004.715650:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00000020:00080000:3.0:1788846004.715655:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788846004.715985:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788846004.715992:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788846004.716011:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788846004.716021:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788846004.723299:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846004.723426:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683453312 00000100:00100000:3.0:1788846004.723442:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683453312 00000100:00100000:3.0:1788846004.723844:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846004.723864:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:11285:x1875740683453312:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788846004.724307:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788846004.724352:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:3.0:1788846004.724394:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.724569:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.724586:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.724598:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.724605:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.724613:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846004.724726:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846004.724794:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846004.724805:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.724815:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846004.724820:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.724830:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.724846:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:0.0:1788846004.724850:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788846004.724855:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846004.724861:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138271fbb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846004.724867:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:11285:x1875740683453312:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 1007us (1577us total) trans 4294967365 rc 0/0 00010000:00010000:0.0:1788846004.724880:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846004.724897:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846004.724900:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846004.733826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000020:00080000:3.0:1788846004.733842:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788846005.052836:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846005.085959:0:14204:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788846005.085969:0:14204:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846005.086005:0:14204:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788846005.086012:0:14204:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788846005.203260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846005.203444:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683453568 00000100:00100000:2.0:1788846005.203454:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683453568 00000100:00100000:2.0:1788846005.203562:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:2.0:1788846005.203573:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:11295:x1875740683453568:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846005.203596:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846005.203616:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271fc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754602 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.203719:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271fc9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.203733:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.203744:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846005.203754:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788846005.203855:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138271fc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754602 expref: 21 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.203872:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754602 expref: 20 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.203881:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846005.203884:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788846005.203888:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031800, rc 0) 00000100:00100000:2.0:1788846005.203942:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:11295:x1875740683453568:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 371us (692us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788846005.203958:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00080000:3.0:1788846005.205186:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846005.209424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846005.209560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683453696 00000100:00100000:3.0:1788846005.209569:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683453696 00000100:00100000:3.0:1788846005.209621:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:3.0:1788846005.209632:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:11295:x1875740683453696:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1788846005.209702:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209719:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209730:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209746:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209752:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209759:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209835:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209844:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209866:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788846005.209909:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209921:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209927:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209933:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209940:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846005.209944:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209951:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209963:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846005.209966:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846005.209970:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209976:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138271fd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.209989:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210002:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210008:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210013:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846005.210016:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210022:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210029:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481700) 00010000:00010000:3.0:1788846005.210032:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846005.210034:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210040:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138271fde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210053:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210059:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210063:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210068:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846005.210076:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210082:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210091:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e461481600) 00010000:00010000:3.0:1788846005.210094:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846005.210096:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.210100:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138271fe5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846005.210256:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:11295:x1875740683453696:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 624us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846005.210263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:3.0:1788846005.277629:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846005.278806:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683453952 00000100:00100000:1.0:1788846005.278817:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683453952 00000100:00100000:1.0:1788846005.278886:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:1.0:1788846005.278897:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:11298:x1875740683453952:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846005.278915:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846005.278946:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271fec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754609 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279021:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279035:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279046:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279061:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279067:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279072:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279193:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279202:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279209:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846005.279217:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788846005.279289:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279307:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279313:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279319:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846005.279323:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279331:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279344:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:1.0:1788846005.279347:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846005.279351:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279357:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138271ff3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279370:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279375:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279380:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279398:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846005.279408:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279414:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279422:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e475235200) 00010000:00010000:1.0:1788846005.279425:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846005.279428:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279433:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138271ffa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279472:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138271fec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279486:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.279493:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:1.0:1788846005.279495:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846005.279497:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3800, rc 0) 00000100:00100000:1.0:1788846005.279610:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11298:x1875740683453952:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 714us (1990us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788846005.279617:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:0.0:1788846005.286599:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846005.286708:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683454080 00000100:00100000:2.0:1788846005.286723:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683454080 00000100:00100000:2.0:1788846005.286800:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:2.0:1788846005.286811:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11298:x1875740683454080:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1788846005.286887:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.286902:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.286913:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.286943:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.286951:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.286957:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.286963:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846005.286967:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.286974:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.286984:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:2.0:1788846005.287001:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846005.287007:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.287012:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827200f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846005.287106:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11298:x1875740683454080:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 297us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846005.287113:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:0.0:1788846005.292347:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846005.292716:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683454336 00000100:00100000:1.0:1788846005.292731:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683454336 00000100:00100000:1.0:1788846005.292865:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1788846005.292877:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11298:x1875740683454336:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:1.0:1788846005.293220:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:11298:x1875740683454336:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 345us (944us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788846005.293229:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1788846005.335055:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846005.335162:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683454592 00000100:00100000:3.0:1788846005.335359:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683454592 00000100:00100000:3.0:1788846005.335441:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:3.0:1788846005.335453:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:10823:x1875740683454592:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846005.335486:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846005.335511:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272016 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754610 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.335762:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.335781:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.335813:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.336262:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.336282:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 24 pid: 6517 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846005.336370:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344441180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702404352:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846005.336601:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846005.340870:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846005.341013:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683454720 00000100:00100000:2.0:1788846005.341026:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683454720 00010000:00010000:2.0:1788846005.341080:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 25 pid: 6517 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846005.341138:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:2.0:1788846005.341158:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:2398:x1875740683454720:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846005.341186:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846005.341194:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 25 pid: 6517 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.341210:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 25 pid: 6517 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.341239:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:2.0:1788846005.341245:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.341280:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.341460:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.341485:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846005.341601:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:2398:x1875740683454720:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 452us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846005.341609:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00010000:00010000:3.0:1788846005.341786:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d56138272001 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754609 expref: 24 pid: 6517 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846005.341807:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344441180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702404352:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846005.341835:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.341853:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.341859:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846005.341880:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788846005.342041:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272016 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.342074:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.342082:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:3.0:1788846005.342085:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788846005.342087:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065800, rc 0) 00000100:00100000:3.0:1788846005.342415:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:10823:x1875740683454592:12345-192.168.203.20@tcp:101:bash.0 Request processed in 6962us (7373us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788846005.342423:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:0.0:1788846005.345808:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846005.345961:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683454848 00000100:00100000:2.0:1788846005.345974:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683454848 00000100:00100000:2.0:1788846005.346080:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:2.0:1788846005.346092:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:10823:x1875740683454848:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846005.346133:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846005.346168:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827202b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754617 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.346221:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272032 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.346238:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.346252:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.346409:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827202b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754617 expref: 26 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.346445:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272032 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754617 expref: 25 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.346455:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:2.0:1788846005.346458:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846005.346462:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030c00, rc 0) 00000100:00100000:2.0:1788846005.346585:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:10823:x1875740683454848:12345-192.168.203.20@tcp:101:bash.0 Request processed in 494us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846005.346592:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:1.0:1788846005.349503:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846005.350779:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683455104 00000100:00100000:0.0:1788846005.350798:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683455104 00000100:00100000:0.0:1788846005.350883:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:0.0:1788846005.350897:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:10823:x1875740683455104:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:0.0:1788846005.351465:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.351489:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.351502:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846005.351657:0:7876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:0.0:1788846005.351685:0:7876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009981ac5b reply state 00000000c0d107c1 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.351699:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.351707:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:0.0:1788846005.351711:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846005.351735:0:7876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788846005.351785:0:7876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:0.0:1788846005.351986:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:10823:x1875740683455104:12345-192.168.203.20@tcp:36:bash.0 Request processed in 1090us (2494us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788846005.351995:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 100 00000020:00080000:0.0:1788846005.352001:0:7876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788846005.355096:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846005.355381:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683455232 00000100:00100000:3.0:1788846005.355395:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683455232 00000100:00100000:3.0:1788846005.355504:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:3.0:1788846005.355516:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:10823:x1875740683455232:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846005.355702:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846005.355730:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272040 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175461e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.355807:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272040 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175461e expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.355824:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272040 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175461e expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.355848:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:3.0:1788846005.355851:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846005.355873:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065400, rc 0) 00000100:00100000:3.0:1788846005.355953:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:10823:x1875740683455232:12345-192.168.203.20@tcp:101:bash.0 Request processed in 439us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846005.355960:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:1.0:1788846005.363044:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846005.363396:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683455360 00000100:00100000:0.0:1788846005.363411:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683455360 00000100:00100000:0.0:1788846005.363542:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:0.0:1788846005.363554:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:10823:x1875740683455360:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846005.363584:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846005.363612:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754625 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846005.363643:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f9fb4, atime: 0x6a9f9fb2, ctime: 0x6a9f9fb4, blocks: 0x8 00010000:00010000:0.0:1788846005.363668:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1788846005.363673:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846005.363681:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.363703:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.363718:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357200, rc 0) 00000100:00100000:0.0:1788846005.363785:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:10823:x1875740683455360:12345-192.168.203.20@tcp:101:bash.0 Request processed in 234us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846005.363792:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:2.0:1788846005.366414:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846005.366514:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683455488 00000100:00100000:3.0:1788846005.366556:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683455488 00002000:00010000:3.0:1788846005.366683:0:8436:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788846005.366689:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e343652680 with x1875740683455488 ext(0->18446744073709551615) 00002000:00010000:3.0:1788846005.366704:0:8436:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e343652680. 00000100:00100000:3.0:1788846005.366738:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:3.0:1788846005.366749:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2400:x1875740683455488:12345-192.168.203.20@tcp:10:bash.0 00002000:00010000:3.0:1788846005.367087:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788846005.367091:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788846004 -> 1788846005 00002000:00010000:3.0:1788846005.367095:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788846002 -> 1788846002 00002000:00010000:3.0:1788846005.367097:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788846004 -> 1788846005 00002000:00010000:3.0:1788846005.367099:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788846005.367544:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2400:x1875740683455488:12345-192.168.203.20@tcp:10:bash.0 Request processed in 774us (1124us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788846005.367553:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00002000:00010000:3.0:1788846005.367558:0:8436:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788846005.367561:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e343652680 with x1875740683455488 ext(0->18446744073709551615) 00002000:00010000:3.0:1788846005.367568:0:8436:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e343652680. 00000100:00100000:2.0:1788846005.472838:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846005.473683:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683455616 00000100:00100000:0.0:1788846005.473696:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683455616 00000100:00100000:0.0:1788846005.473782:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:0.0:1788846005.473793:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:11312:x1875740683455616:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:0.0:1788846005.473906:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.473927:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.473941:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.473959:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.473967:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.473974:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474066:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474076:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474084:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846005.474160:0:7876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474716:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474722:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474730:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474736:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846005.474741:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474749:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474764:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846005.474767:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846005.474773:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474779:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827204e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474797:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474802:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474807:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474820:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846005.474824:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474830:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474839:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e4514bd900) 00010000:00010000:0.0:1788846005.474852:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846005.474856:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474862:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272055 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474878:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474884:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474890:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474895:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846005.474898:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474904:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474923:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:0.0:1788846005.474926:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846005.474929:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.474935:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827205c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846005.475045:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:11312:x1875740683455616:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 1250us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846005.475055:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:2.0:1788846005.512733:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846005.512796:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683455872 00000100:00100000:3.0:1788846005.512810:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683455872 00000100:00100000:3.0:1788846005.512886:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:3.0:1788846005.512897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:11315:x1875740683455872:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846005.512944:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846005.512972:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272063 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175462c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513067:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513086:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513100:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513118:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513125:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513132:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513400:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272078 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513410:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.513418:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272078 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846005.513429:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788846005.514055:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514066:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514073:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514080:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846005.514085:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514094:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514110:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846005.514113:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846005.514118:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514125:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827206a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514141:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514156:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514162:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514168:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846005.514598:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514610:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514621:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481600) 00010000:00010000:3.0:1788846005.514624:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846005.514635:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514642:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272071 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514701:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272063 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175462c expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514715:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272078 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175462c expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.514724:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:3.0:1788846005.514726:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788846005.514729:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065e00, rc 0) 00000100:00100000:3.0:1788846005.514999:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:11315:x1875740683455872:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2102us (2279us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788846005.515007:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:3.0:1788846005.517874:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846005.518020:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683456000 00000100:00100000:1.0:1788846005.518034:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683456000 00000100:00100000:1.0:1788846005.518105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:1.0:1788846005.518126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:11315:x1875740683456000:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1788846005.518215:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.518235:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.518245:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.518287:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.518303:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 32 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846005.518319:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702404480:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846005.518909:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484dff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788846005.523656:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702404480:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846005.523695:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846005.523882:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846005.524228:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683456256 00000100:00100000:1.0:1788846005.524237:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683456256 00000100:00100000:1.0:1788846005.524311:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1788846005.524322:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:6167:x1875740683456256:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788846005.524727:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+34:6167:x1875740683456256:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 405us (844us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788846005.524735:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1788846005.530455:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846005.530568:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683456384 00000100:00100000:0.0:1788846005.530581:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683456384 00010000:00010000:0.0:1788846005.530639:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 34 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846005.530685:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:0.0:1788846005.530696:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+34:2398:x1875740683456384:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846005.530715:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846005.530722:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 34 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.530737:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 34 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.530766:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827201d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754610 expref: 34 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.530809:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:0.0:1788846005.530816:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.530828:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.530837:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.530859:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846005.530927:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:2398:x1875740683456384:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 233us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846005.530936:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00010000:00010000:2.0:1788846005.531475:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.531486:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.531553:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.531560:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.531568:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.531780:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846005.531786:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.531795:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.531808:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:2.0:1788846005.531811:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846005.531815:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.531822:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272086 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846005.531889:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:11315:x1875740683456000:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 13772us (14028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846005.531898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:1.0:1788846005.534968:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846005.537213:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683456640 00000100:00100000:3.0:1788846005.537231:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683456640 00000100:00100000:3.0:1788846005.537367:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788846005.537379:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:11315:x1875740683456640:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1788846005.539099:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:11315:x1875740683456640:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 1708us (4132us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788846005.539180:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788846005.562499:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702404608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846005.562632:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846005.562713:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788846005.562720:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702404736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846005.562747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846005.562823:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702404608 00000100:00100000:1.0:1788846005.562835:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702404608 00000100:00100000:1.0:1788846005.562962:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702404736 00000100:00100000:1.0:1788846005.562966:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702404736 00000100:00100000:1.0:1788846005.562986:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788846005.562996:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702404608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788846005.563035:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846005.563102:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702404608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846005.563110:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788846005.563129:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788846005.563135:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875740702404736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788846005.563156:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846005.563181:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875740702404736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846005.563187:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788846005.563250:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702404736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846005.563268:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702404608:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788846005.569298:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846005.663765:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846005.664304:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683456896 00000100:00100000:2.0:1788846005.664318:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683456896 00000100:00100000:2.0:1788846005.664416:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:2.0:1788846005.664428:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:11326:x1875740683456896:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1788846005.664463:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846005.664491:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d5613827208d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754633 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.664645:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.664684:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.664700:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.664721:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.664729:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.664736:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.665793:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382720a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.665815:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382720a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.665827:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382720a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846005.665841:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788846005.666343:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666353:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666360:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666380:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846005.666385:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666394:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666410:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846005.666414:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846005.666419:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666425:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272094 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666444:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666450:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666456:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666461:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846005.666464:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666471:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666490:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e3437a7200) 00010000:00010000:2.0:1788846005.666492:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846005.666495:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666502:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d5613827209b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666625:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d5613827208d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754633 expref: 36 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666642:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382720a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754633 expref: 35 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846005.666650:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:2.0:1788846005.666653:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846005.666655:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031a00, rc 0) 00000100:00100000:2.0:1788846005.666750:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:11326:x1875740683456896:12345-192.168.203.20@tcp:101:cat.0 Request processed in 2322us (3009us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788846005.666760:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:0.0:1788846005.674470:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846005.679886:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683457152 00000100:00100000:1.0:1788846005.679984:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683457152 00000100:00100000:1.0:1788846005.680292:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1788846005.680306:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:11326:x1875740683457152:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:1.0:1788846005.680769:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+36:11326:x1875740683457152:12345-192.168.203.20@tcp:35:cat.0 Request processed in 464us (6312us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788846005.680778:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1788846005.700067:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846005.700371:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683457408 00000100:00100000:3.0:1788846005.700384:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683457408 00000100:00100000:3.0:1788846005.700512:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:3.0:1788846005.700581:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+36:11327:x1875740683457408:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:3.0:1788846005.700658:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788846005.700693:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272040 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175461e expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700722:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382720a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754633 expref: 35 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700738:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272078 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175462c expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700774:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272032 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754617 expref: 33 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700788:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:3.0:1788846005.700794:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846005.700833:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700849:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700862:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700878:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700886:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.700893:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701001:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701011:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701018:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846005.701311:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788846005.701322:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389738800462ns, next at 390738797571ns, rc = 0 00010000:00010000:3.0:1788846005.701374:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701384:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701394:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701402:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701410:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701417:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701447:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846005.701472:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701479:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701487:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701494:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846005.701505:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701515:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701586:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:3.0:1788846005.701590:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788846005.701595:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701602:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720be lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701621:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701629:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701635:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701641:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846005.701644:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701652:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701659:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846005.701662:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846005.701671:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701678:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788846005.701689:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038c43948 reply state 00000000059b485f transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701703:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.701710:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481600) 00010000:00010000:3.0:1788846005.701713:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788846005.701716:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788846005.701809:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+34:11327:x1875740683457408:12345-192.168.203.20@tcp:36:rm.0 Request processed in 1284us (1754us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788846005.701819:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 106 00010000:00010000:0.0:1788846005.701908:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846005.701917:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.701926:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846005.701931:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.701938:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.701956:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:0.0:1788846005.701959:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788846005.701962:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.701969:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382720c5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.701982:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846005.701984:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846005.701986:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846005.760316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846005.763194:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683457664 00000100:00100000:2.0:1788846005.763215:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683457664 00000100:00100000:3.0:1788846005.767177:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:3.0:1788846005.767198:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+34:11333:x1875740683457664:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846005.767235:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846005.767264:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175463a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.767434:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.767454:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.767467:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.767489:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.767496:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.767503:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788846005.769124:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788846005.769368:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769388:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769639:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769693:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769701:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769708:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769715:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846005.769720:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769749:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769765:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846005.769768:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846005.769772:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.769778:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382720d3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788846005.769797:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ad847d1 reply state 000000000d0708c4 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.770054:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.770062:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481600) 00010000:00010000:3.0:1788846005.770064:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788846005.770068:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788846005.770123:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d561382720cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.770152:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.770161:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481700) 00010000:00010000:3.0:1788846005.770163:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846005.770166:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065400, rc 0) 00000100:00100000:3.0:1788846005.770273:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:11333:x1875740683457664:12345-192.168.203.20@tcp:101:bash.0 Request processed in 3079us (9971us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788846005.770290:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:0.0:1788846005.777235:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846005.777955:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683457792 00000100:00100000:3.0:1788846005.777969:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683457792 00000100:00100000:3.0:1788846005.778064:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:3.0:1788846005.778075:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2400:x1875740683457792:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846005.778098:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846005.778137:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754641 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846005.778179:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846005.778206:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1788846005.778211:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846005.778223:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.778249:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846005.778266:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065000, rc 0) 00000100:00080000:1.0:1788846005.778543:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846005.779206:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2400:x1875740683457792:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1125us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846005.779218:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:1.0:1788846005.809003:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846005.809285:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683457920 00000100:00100000:0.0:1788846005.809300:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683457920 00000100:00100000:0.0:1788846005.809375:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:0.0:1788846005.809386:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:11333:x1875740683457920:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846005.809410:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846005.809435:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754648 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.809478:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.809489:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846005.809494:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846005.809501:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.809709:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.809727:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 9 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846005.809744:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875740702404864:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846005.809983:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788846005.822216:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846005.822378:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875740702404864:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846005.822437:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846005.822466:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356000, rc 0) 00000100:00100000:1.0:1788846005.822578:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683458048 00000100:00100000:0.0:1788846005.822580:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:11333:x1875740683457920:12345-192.168.203.20@tcp:101:bash.0 Request processed in 13194us (13589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846005.822591:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683458048 00000100:00100000:0.0:1788846005.822595:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00010000:00010000:1.0:1788846005.822641:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 9 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846005.822681:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1788846005.822692:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683458048:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846005.822708:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846005.822736:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 9 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.822752:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 9 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.822785:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063bc7d81/0x21b4d561382720ef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754641 expref: 9 pid: 8432 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.822817:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846005.822841:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846005.822853:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.822864:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846005.822907:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846005.822936:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f595880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1875740702404992:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846005.823029:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484df000 going to sleep for 11 seconds 00000100:00100000:2.0:1788846005.829634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846005.829794:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f595880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1875740702404992:192.168.203.20@tcp:105: 00010000:00010000:1.0:1788846005.829827:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846005.829905:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683458048:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 7213us (7702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846005.829918:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:3.0:1788846005.835866:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683458304 00000100:00100000:3.0:1788846005.835928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683458304 00000100:00100000:3.0:1788846005.836076:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:3.0:1788846005.836090:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:11333:x1875740683458304:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1788846005.836776:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:11333:x1875740683458304:12345-192.168.203.20@tcp:35:bash.0 Request processed in 685us (7153us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788846005.836786:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788846006.023062:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.024685:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683458432 00000100:00100000:2.0:1788846006.024705:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683458432 00000100:00100000:2.0:1788846006.024820:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:2.0:1788846006.024833:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:11349:x1875740683458432:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846006.024888:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846006.025058:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382720fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175464f expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.025159:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272104 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.025179:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.025196:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846006.025270:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788846006.025275:0:7876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846006.025385:0:7876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.025496:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382720fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175464f expref: 40 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.025657:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272104 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175464f expref: 39 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.025668:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846006.025672:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846006.025676:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031c00, rc 0) 00000100:00100000:2.0:1788846006.025782:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:11349:x1875740683458432:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 951us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.025790:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:2.0:1788846006.030342:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.030569:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683458688 00000100:00100000:3.0:1788846006.030583:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683458688 00000100:00100000:3.0:1788846006.030658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:3.0:1788846006.030671:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:11349:x1875740683458688:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846006.030697:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846006.030722:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827210b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754656 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.030866:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272112 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.030882:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.030905:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272112 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846006.030917:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788846006.031038:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827210b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754656 expref: 42 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.031056:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272112 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754656 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.031065:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481700) 00010000:00010000:3.0:1788846006.031084:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846006.031088:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065a00, rc 0) 00000100:00100000:3.0:1788846006.031172:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+41:11349:x1875740683458688:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 503us (845us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788846006.031179:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:0.0:1788846006.040588:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.040646:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.040704:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683458944 00000100:00100000:3.0:1788846006.040717:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683458944 00000100:00100000:1.0:1788846006.040778:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683459072 00000100:00100000:1.0:1788846006.040784:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683459072 00000100:00100000:3.0:1788846006.040803:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:3.0:1788846006.040814:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:11349:x1875740683458944:12345-192.168.203.20@tcp:101:lfs.0 00000100:00100000:1.0:1788846006.040831:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:1.0:1788846006.040837:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:2399:x1875740683459072:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846006.040841:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846006.040851:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846006.040864:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272120 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175465d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.040878:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272112 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754656 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.040897:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481700) 00010000:00010000:1.0:1788846006.040922:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846006.040995:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:2399:x1875740683459072:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 158us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846006.041002:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00010000:00010000:3.0:1788846006.041005:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272127 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.041022:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272127 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.041034:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272127 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846006.041048:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788846006.041196:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272120 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175465d expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.041211:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272127 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175465d expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.041232:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481700) 00010000:00010000:3.0:1788846006.041235:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788846006.041452:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065000, rc 0) 00000100:00100000:3.0:1788846006.041637:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:11349:x1875740683458944:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 823us (1063us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1788846006.041648:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:0.0:1788846006.047943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.048003:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683459200 00000100:00100000:3.0:1788846006.048017:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683459200 00000100:00100000:3.0:1788846006.048101:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:3.0:1788846006.048113:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683459200:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:3.0:1788846006.048182:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.048209:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.048220:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788846006.048225:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846006.048230:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.048280:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.048309:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 8 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846006.048347:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344440700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875740702405120:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846006.048474:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788846006.050998:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344440700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875740702405120:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846006.051038:0:8906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.053396:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.062693:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683459328 00000100:00100000:2.0:1788846006.062716:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683459328 00002000:00100000:2.0:1788846006.062802:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff90e3439e7480 x1875740683459328/t0(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:357/0 lens 504/0 e 0 to 0 dl 1788846017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788846006.062813:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e3439e7480 with x1875740683459328 ext(0->8) 00010000:00010000:2.0:1788846006.062827:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 9 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.062847:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 9 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846006.062858:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e3439e7480 00000100:00100000:2.0:1788846006.062903:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1788846006.062915:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2399:x1875740683459328:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:3.0:1788846006.066282:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:2399:x1875740683459328:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 3353us (12882us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788846006.066301:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00002000:00100000:3.0:1788846006.066319:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff90e3439e7480 x1875740683459328/t4294967303(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:357/0 lens 504/448 e 0 to 0 dl 1788846017 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788846006.066331:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e3439e7480 with x1875740683459328 ext(0->8) 00010000:00010000:3.0:1788846006.066344:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 11 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.066382:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 11 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846006.066391:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e3439e7480 00000100:00100000:2.0:1788846006.074252:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702405248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846006.074352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.074431:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702405248 00000100:00100000:2.0:1788846006.074441:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702405248 00000100:00100000:2.0:1788846006.074503:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788846006.074513:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702405248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846006.074588:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788846006.074644:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f537b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702405248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.074651:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788846006.074708:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702405248:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788846006.077248:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846006.078392:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846006.078756:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788846006.078783:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702405504:0@lo:400:kworker.0 00000100:00100000:3.0:1788846006.079197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846006.079269:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702405504 00000100:00100000:3.0:1788846006.079295:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702405504 00000100:00100000:3.0:1788846006.079363:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788846006.079374:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702405504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846006.079441:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702405504:12345-0@lo:400:kworker.0 Request processed in 68us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.079449:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788846006.079502:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702405504:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.079680:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.079709:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683459456 00000100:00100000:2.0:1788846006.079715:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683459456 00010000:00010000:2.0:1788846006.079749:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 11 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.079779:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1788846006.079787:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:2398:x1875740683459456:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846006.079799:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788846006.079821:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788846006.079824:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788846006 00002000:00010000:2.0:1788846006.079827:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788846006 00002000:00010000:2.0:1788846006.079830:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788846006 00002000:00010000:2.0:1788846006.079832:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788846006.079852:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 11 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.079867:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 11 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.079897:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d561382720f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754648 expref: 11 pid: 8430 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.079917:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788846006.079922:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788846006.079929:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.079950:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.079983:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846006.080033:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:2398:x1875740683459456:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 246us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.080040:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:3.0:1788846006.080722:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702405632:0@lo:400:kworker.0 00000100:00100000:3.0:1788846006.080789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846006.082342:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702405760:0@lo:400:kworker.0 00000100:00100000:0.0:1788846006.082430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846006.082470:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702405760 00000100:00100000:0.0:1788846006.082479:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702405760 00000100:00100000:0.0:1788846006.082556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788846006.082576:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702405760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846006.082637:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702405760:12345-0@lo:400:kworker.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.082645:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788846006.082694:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702405760:0@lo:400:kworker.0 00000100:00100000:0.0:1788846006.082703:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702405376:0@lo:400:kworker.0 00000100:00100000:0.0:1788846006.082734:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846006.085790:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702405632 00000100:00100000:1.0:1788846006.085813:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702405632 00000100:00100000:2.0:1788846006.087097:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702405376 00000100:00100000:2.0:1788846006.087122:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702405376 00000100:00100000:2.0:1788846006.087207:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788846006.087220:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702405376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.087337:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702405376:12345-0@lo:400:kworker.0 Request processed in 119us (4601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.087346:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788846006.087441:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702405888:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.087484:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.087600:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702406016:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.087630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.087677:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846006.087683:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702406144:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.087711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.087740:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702406144 00000100:00100000:2.0:1788846006.087744:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702406144 00000100:00100000:2.0:1788846006.087775:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788846006.087782:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702406144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.087866:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702406144:12345-0@lo:400:kworker.0 Request processed in 84us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.087873:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788846006.087919:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702406144:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.087959:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846006.087966:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702406272:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.087992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.088030:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702406400:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.088094:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702406528:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.088189:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846006.088195:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702406656:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.088243:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702406272 00000100:00100000:2.0:1788846006.088246:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702406272 00000100:00100000:2.0:1788846006.088276:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702406656 00000100:00100000:2.0:1788846006.088279:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702406656 00000100:00100000:2.0:1788846006.088297:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788846006.088302:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875740702406272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088339:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875740702406272:12345-0@lo:400:kworker.0 Request processed in 35us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.088345:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788846006.088358:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788846006.088364:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702406656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088405:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702406656:12345-0@lo:400:kworker.0 Request processed in 41us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.088412:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788846006.088429:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788846006.088433:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846006.088450:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702406272:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088473:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702406656:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088502:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846006.088510:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702406784:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088569:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.088590:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702406784 00000100:00100000:2.0:1788846006.088593:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702406784 00000100:00100000:2.0:1788846006.088622:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788846006.088628:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702406784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088660:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702406784:12345-0@lo:400:kworker.0 Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.088666:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788846006.088679:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846006.088693:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702406784:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088725:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702405888 00000100:00100000:2.0:1788846006.088729:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702405888 00000100:00080000:2.0:1788846006.088746:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846006.088769:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702406016 00000100:00100000:2.0:1788846006.088773:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702406016 00000100:00080000:2.0:1788846006.088787:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846006.088798:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702406400 00000100:00100000:2.0:1788846006.088800:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702406400 00000100:00080000:2.0:1788846006.088820:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846006.088834:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702406528 00000100:00100000:2.0:1788846006.088837:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702406528 00000100:00080000:2.0:1788846006.088849:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846006.088867:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00010000:00010000:3.0:1788846006.088875:0:8906:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.088875:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702405888:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1788846006.088894:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.088919:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702405888:12345-0@lo:400:kworker.0 Request processed in 45us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.088927:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788846006.088952:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702405888:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.088972:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788846006.088979:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702406016:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1788846006.089007:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.089016:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702406016:12345-0@lo:400:kworker.0 Request processed in 36us (1383us total) trans 0 rc 0/0 00010000:00010000:3.0:1788846006.089026:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.089029:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00010000:3.0:1788846006.089040:0:8906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.089048:0:8906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846006.089054:0:8906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788846006.089059:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f534380 x1875740702406016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846006.089084:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702406016:0@lo:400:kworker.0 00010000:00010000:3.0:1788846006.089087:0:8906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.089103:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788846006.089112:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702406400:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1788846006.089115:0:8906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.089126:0:8906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272135 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.089158:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702406400:12345-0@lo:400:kworker.0 Request processed in 47us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.089164:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788846006.089189:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702406400:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.089211:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788846006.089227:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702406528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.089267:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702406528:12345-0@lo:400:kworker.0 Request processed in 40us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.089276:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683459200:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 41160us (41343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.089278:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788846006.089291:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00010000:00080000:2.0:1788846006.089308:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439f4380 x1875740702406528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846006.089321:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702406528:0@lo:400:kworker.0 00000100:00100000:1.0:1788846006.090278:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788846006.090292:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702405632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846006.090368:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702405632:12345-0@lo:400:kworker.0 Request processed in 81us (9579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846006.090375:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788846006.094762:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702405376:0@lo:400:kworker.0 00000100:00100000:3.0:1788846006.097214:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702405632:0@lo:400:kworker.0 00000100:00100000:2.0:1788846006.099281:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846006.100358:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683459712 00000100:00100000:1.0:1788846006.100376:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683459712 00000100:00100000:1.0:1788846006.100464:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:1.0:1788846006.100477:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:11349:x1875740683459712:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:1.0:1788846006.100607:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272127 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175465d expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788846006.100845:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788846006.100879:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1788846006.107792:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:0.0:1788846006.107896:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.107925:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.107936:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.107990:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.108013:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 46 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.108033:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875740702406912:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846006.108190:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846006.116666:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.118488:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683459840 00000100:00100000:3.0:1788846006.118507:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683459840 00010000:00010000:3.0:1788846006.118622:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 47 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846006.118677:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:3.0:1788846006.118689:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:2399:x1875740683459840:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846006.118707:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846006.118716:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 47 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.118754:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 47 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.118785:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481700) 00010000:00010000:3.0:1788846006.118792:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.118803:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.118812:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.118837:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846006.118920:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:2399:x1875740683459840:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 232us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.118929:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00010000:00010000:0.0:1788846006.122366:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382720e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175463a expref: 46 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.122403:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875740702406912:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846006.122436:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.122448:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.122455:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846006.123374:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:0.0:1788846006.123541:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788846006.123676:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702407040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788846006.123764:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846006.123814:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846006.124255:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702407040 00000100:00100000:3.0:1788846006.124266:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702407040 00000100:00100000:3.0:1788846006.124338:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788846006.124348:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1875740702407040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788846006.124463:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1875740702407040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 116us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.124472:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788846006.124784:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702407040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788846006.125247:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1788846006.125341:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f595880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702407168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788846006.125398:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846006.125438:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495410c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846006.125623:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702407168 00000100:00100000:3.0:1788846006.125629:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702407168 00000100:00100000:3.0:1788846006.125673:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788846006.125682:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875740702407168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788846006.125835:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6519:x1875740702407168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 153us (436us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788846006.125855:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788846006.127818:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f595880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702407168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788846006.127941:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788846006.128015:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.128027:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.128035:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.128042:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846006.128047:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.128056:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.128074:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481700) 00010000:00010000:1.0:1788846006.128077:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788846006.128081:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.128088:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d5613827213c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788846006.129815:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788846006.130365:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788846006.130384:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390167862453ns, next at 391167858041ns, rc = 0 00000001:00080000:1.0:1788846006.130396:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:1.0:1788846006.130460:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481700) 00010000:00010000:1.0:1788846006.130483:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788846006.130498:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272127 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175465d expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.134536:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+49:11349:x1875740683459712:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 34028us (35235us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788846006.134562:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000020:00080000:0.0:1788846006.134571:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788846006.139245:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.139390:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683459968 00000100:00100000:3.0:1788846006.139404:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683459968 00000100:00100000:3.0:1788846006.139480:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:3.0:1788846006.139493:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+49:11349:x1875740683459968:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846006.139565:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846006.139598:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272143 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754664 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.139676:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272143 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754664 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.139694:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272143 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754664 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.139717:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:3.0:1788846006.139720:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846006.139725:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064400, rc 0) 00000100:00100000:3.0:1788846006.139798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+50:11349:x1875740683459968:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 307us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.139805:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:1.0:1788846006.147486:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.148004:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683460224 00000100:00100000:3.0:1788846006.148019:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683460224 00000100:00100000:3.0:1788846006.148096:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1788846006.148108:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+50:11349:x1875740683460224:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1788846006.148447:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+51:11349:x1875740683460224:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 340us (974us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788846006.148456:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1788846006.286787:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.288909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683460352 00000100:00100000:3.0:1788846006.288928:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683460352 00000100:00100000:2.0:1788846006.291478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:2.0:1788846006.291495:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+51:11359:x1875740683460352:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1788846006.291628:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291650:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291665:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291679:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291688:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291695:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291809:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291819:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291826:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846006.291900:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291917:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291924:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291933:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291940:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846006.291945:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291955:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291971:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846006.291974:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846006.291980:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.291993:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d5613827214a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.292013:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.292020:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.292026:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.292032:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846006.292035:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.292042:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.292050:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481600) 00010000:00010000:2.0:1788846006.292053:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846006.292056:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.292063:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272151 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.293740:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.293751:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.293777:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.293785:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846006.293789:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.293797:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.293814:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:2.0:1788846006.293818:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846006.293822:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.293828:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272158 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.293996:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+51:11359:x1875740683460352:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 2500us (7220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.294009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 112 00000100:00100000:2.0:1788846006.359716:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.359840:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683460608 00000100:00100000:3.0:1788846006.359855:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683460608 00000100:00100000:3.0:1788846006.359942:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:3.0:1788846006.359954:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+51:11362:x1875740683460608:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846006.359983:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846006.360011:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827215f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175466b expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360107:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360126:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360149:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360163:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360172:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360179:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360350:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360359:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360366:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846006.360377:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788846006.360476:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360483:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360490:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360496:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846006.360501:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360510:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360582:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846006.360586:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846006.360591:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360611:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272166 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360628:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360634:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360640:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360645:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846006.360649:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360656:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360664:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481600) 00010000:00010000:3.0:1788846006.360668:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846006.360671:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360676:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d5613827216d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360721:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827215f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 54 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360750:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 53 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.360759:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:3.0:1788846006.360762:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846006.360764:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065000, rc 0) 00000100:00100000:3.0:1788846006.360842:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+53:11362:x1875740683460608:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 889us (1138us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788846006.360851:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 113 00000100:00100000:0.0:1788846006.376602:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.376792:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683460736 00000100:00100000:2.0:1788846006.376808:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683460736 00000100:00100000:2.0:1788846006.376878:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:2.0:1788846006.376889:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+53:11362:x1875740683460736:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1788846006.376975:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377016:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377029:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377072:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377078:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377085:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377092:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846006.377097:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377105:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377117:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:2.0:1788846006.377120:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846006.377124:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.377131:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272182 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.377238:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+53:11362:x1875740683460736:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 351us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.377252:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:1.0:1788846006.383670:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.383773:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683460992 00000100:00100000:3.0:1788846006.383787:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683460992 00000100:00100000:3.0:1788846006.383861:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1788846006.383874:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+53:11362:x1875740683460992:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1788846006.384211:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:11362:x1875740683460992:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 336us (553us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788846006.384219:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:3.0:1788846006.483069:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.483371:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683461248 00000100:00100000:2.0:1788846006.483386:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683461248 00000100:00100000:2.0:1788846006.483477:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:2.0:1788846006.483489:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:11372:x1875740683461248:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846006.483560:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846006.484069:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788846006.484108:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272104 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175464f expref: 54 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.484134:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846006.484148:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846006.484165:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272189 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754672 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.484507:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.484739:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 54 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.484749:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.484790:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 54 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.484807:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 54 pid: 12145 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.484832:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702407296:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846006.485102:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788846006.488365:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.488673:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702407296:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846006.488710:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846006.489443:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683461376 00000100:00100000:3.0:1788846006.489456:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683461376 00010000:00010000:3.0:1788846006.489514:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 55 pid: 12145 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846006.489611:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:3.0:1788846006.489624:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:2399:x1875740683461376:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846006.489644:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846006.489670:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 55 pid: 12145 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.489683:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 55 pid: 12145 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.489715:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272174 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175466b expref: 55 pid: 12145 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.489735:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:3.0:1788846006.489741:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.489752:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.489761:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.489790:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846006.489871:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:2399:x1875740683461376:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 248us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.489879:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00010000:00010000:2.0:1788846006.490691:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.490706:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846006.490732:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788846006.490919:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272189 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.490942:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.490951:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:2.0:1788846006.490954:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788846006.490958:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030c00, rc 0) 00000100:00100000:2.0:1788846006.491025:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:11372:x1875740683461248:12345-192.168.203.20@tcp:101:bash.0 Request processed in 7538us (7970us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788846006.491034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:3.0:1788846006.500990:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.501104:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683461504 00000100:00100000:0.0:1788846006.501129:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683461504 00000100:00100000:0.0:1788846006.501214:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:0.0:1788846006.501225:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:11372:x1875740683461504:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846006.501275:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846006.501315:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d5613827219e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754679 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.501359:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.501377:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.501392:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.501587:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d5613827219e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 56 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.501614:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.501625:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:0.0:1788846006.501629:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846006.501634:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357e00, rc 0) 00000100:00100000:0.0:1788846006.501705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:11372:x1875740683461504:12345-192.168.203.20@tcp:101:bash.0 Request processed in 481us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.501713:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:3.0:1788846006.509277:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846006.509478:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683461760 00000100:00100000:1.0:1788846006.509493:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683461760 00000100:00100000:1.0:1788846006.511231:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:1.0:1788846006.511265:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:11372:x1875740683461760:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:1.0:1788846006.512385:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.512412:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.512428:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788846006.512483:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:1.0:1788846006.512510:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fadf1b6d reply state 00000000ff0518ee transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.512562:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.512571:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846006.512574:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788846006.512597:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788846006.512762:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:11372:x1875740683461760:12345-192.168.203.20@tcp:36:bash.0 Request processed in 1509us (3497us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788846006.519454:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000020:00080000:1.0:1788846006.519471:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788846006.521917:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.522028:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683461888 00000100:00100000:2.0:1788846006.522060:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683461888 00000100:00100000:2.0:1788846006.522134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:2.0:1788846006.522158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:11372:x1875740683461888:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846006.522190:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846006.522215:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d561382721b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754680 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.522347:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.522367:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.522377:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.522416:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.522432:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 59 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.522450:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702407424:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846006.522947:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846006.532192:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.532856:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702407424:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846006.532905:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.533289:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683462016 00000100:00100000:1.0:1788846006.533299:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683462016 00010000:00010000:1.0:1788846006.533350:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 60 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.533396:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:1.0:1788846006.533408:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:2399:x1875740683462016:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846006.533425:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846006.533434:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 60 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.533449:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 60 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.533477:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272190 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754672 expref: 60 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.533501:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846006.533507:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.533575:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.533979:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.534055:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846006.534156:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:2399:x1875740683462016:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 747us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846006.534165:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00010000:00010000:3.0:1788846006.536243:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.536261:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846006.536829:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788846006.536844:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846006.536876:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.537036:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d561382721b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.537063:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 58 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.537073:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:2.0:1788846006.537077:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846006.537080:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031c00, rc 0) 00000100:00100000:2.0:1788846006.537288:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:11372:x1875740683461888:12345-192.168.203.20@tcp:101:bash.0 Request processed in 15130us (15382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.537297:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:0.0:1788846006.545268:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.549506:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683462272 00000100:00100000:3.0:1788846006.549728:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683462272 00000100:00100000:2.0:1788846006.550384:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1788846006.550399:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:11372:x1875740683462272:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1788846006.550758:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:11372:x1875740683462272:12345-192.168.203.20@tcp:35:bash.0 Request processed in 362us (5505us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788846006.550767:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1788846006.586172:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702407552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788846006.586283:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846006.586423:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702407552 00000100:00100000:0.0:1788846006.586451:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702407552 00000100:00100000:0.0:1788846006.586546:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788846006.586574:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702407552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788846006.586616:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788846006.586897:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788846006.586911:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702407680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788846006.586946:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846006.586986:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702407680 00000100:00100000:3.0:1788846006.586990:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702407680 00000100:00100000:3.0:1788846006.587017:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788846006.587024:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702407680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846006.587037:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788846006.587068:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702407680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.587075:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788846006.587128:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702407680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846006.587504:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702407552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 938us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.587512:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788846006.587781:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702407552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846006.660726:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.661216:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683462400 00000100:00100000:2.0:1788846006.661235:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683462400 00000100:00100000:2.0:1788846006.661358:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:2.0:1788846006.661372:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:11378:x1875740683462400:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846006.661426:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846006.661452:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d561382721c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754687 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.661589:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382721c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.661606:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382721c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.661619:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382721c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846006.661675:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788846006.661679:0:7876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846006.661705:0:7876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382721c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.661737:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d561382721c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754687 expref: 61 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.661763:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382721c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754687 expref: 60 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.661773:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846006.661776:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846006.661781:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031a00, rc 0) 00000100:00100000:2.0:1788846006.664379:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11378:x1875740683462400:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2987us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.664396:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:3.0:1788846006.669712:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.669949:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683462528 00000100:00100000:2.0:1788846006.669962:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683462528 00000100:00100000:2.0:1788846006.670039:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:2.0:1788846006.670050:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11378:x1875740683462528:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846006.670155:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846006.670182:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d561382721cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175468e expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670265:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670282:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670296:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670309:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670317:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670324:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670420:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382721e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670430:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382721e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.670462:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382721e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846006.670517:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788846006.670711:0:12145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846006.671999:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382721e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672028:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382721e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672039:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672046:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672054:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672093:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846006.672098:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672106:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672124:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846006.672127:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846006.672132:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672149:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382721d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672175:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672181:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672187:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672191:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846006.672194:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672200:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672219:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481600) 00010000:00010000:3.0:1788846006.672221:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846006.672225:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672232:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672282:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d561382721cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175468e expref: 62 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672297:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382721e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175468e expref: 61 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.672305:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:3.0:1788846006.672307:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846006.672310:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030c00, rc 0) 00000100:00100000:3.0:1788846006.672417:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11378:x1875740683462528:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2367us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.672427:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:3.0:1788846006.677712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.677767:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.678079:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683462912 00000100:00100000:0.0:1788846006.678093:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683462912 00000100:00100000:0.0:1788846006.678187:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:0.0:1788846006.678200:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:2399:x1875740683462912:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846006.678220:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846006.678252:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382721e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175468e expref: 61 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.678276:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:0.0:1788846006.678282:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846006.678364:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:2399:x1875740683462912:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 167us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.678373:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1788846006.678679:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683462784 00000100:00100000:2.0:1788846006.678685:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683462784 00000100:00100000:2.0:1788846006.678720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:2.0:1788846006.678727:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11378:x1875740683462784:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846006.678747:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846006.678765:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d561382721eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754695 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.678894:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.678912:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.678969:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.679011:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.679028:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 61 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.679083:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702407808:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846006.679194:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80840 going to sleep for 11 seconds 00000100:00100000:3.0:1788846006.682299:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.682448:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702407808:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846006.682484:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.688662:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683463040 00000100:00100000:1.0:1788846006.688685:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683463040 00010000:00010000:1.0:1788846006.688755:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 62 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.688815:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:1.0:1788846006.688827:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:2398:x1875740683463040:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846006.688858:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846006.688866:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 62 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.688883:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 62 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.688911:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382721ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754680 expref: 62 pid: 6516 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.688941:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846006.688965:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.688978:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.688988:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.689022:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846006.689306:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:2398:x1875740683463040:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 480us (7021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846006.689315:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00010000:00010000:3.0:1788846006.689873:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.689885:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846006.689924:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788846006.690284:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d561382721eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 62 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.690306:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 61 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.690315:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:3.0:1788846006.690317:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788846006.690320:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031e00, rc 0) 00000100:00100000:3.0:1788846006.690423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11378:x1875740683462784:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 11695us (12764us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788846006.690432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:3.0:1788846006.709767:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.709918:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683463296 00000100:00100000:2.0:1788846006.709932:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683463296 00000100:00100000:2.0:1788846006.710021:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:2.0:1788846006.710034:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11378:x1875740683463296:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:2.0:1788846006.710053:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846006.710314:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272143 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754664 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.710341:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:2.0:1788846006.710347:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846006.710455:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11378:x1875740683463296:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 423us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.710463:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:1.0:1788846006.719902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.720322:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683463424 00000100:00100000:2.0:1788846006.720336:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683463424 00000100:00100000:2.0:1788846006.720422:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:2.0:1788846006.720435:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11378:x1875740683463424:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:2.0:1788846006.720660:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.720690:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.720705:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846006.720845:0:7876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788846006.720972:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11378:x1875740683463424:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 537us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.720980:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:0.0:1788846006.726266:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.726861:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683463552 00000100:00100000:3.0:1788846006.726874:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683463552 00000100:00100000:3.0:1788846006.726950:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:3.0:1788846006.726961:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:11378:x1875740683463552:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846006.726986:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846006.727009:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175469c expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.727076:0:12145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.727087:0:12145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 61 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.727142:0:12145:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.727158:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 61 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.727175:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:3.0:1788846006.727178:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846006.727181:0:12145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 61 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.727190:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065000, rc 0) 00000100:00100000:3.0:1788846006.727269:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11378:x1875740683463552:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 309us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.727278:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000040:00080000:1.0:1788846006.777799:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788846006.777812:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788846006.777871:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788846006.777886:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788846006.778066:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f596a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702407936:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788846006.778498:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541000 going to sleep for 11 seconds 00000100:00100000:1.0:1788846006.783618:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f596a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702407936:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788846006.783669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.783757:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683463680 00000100:00100000:3.0:1788846006.783771:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683463680 00000100:00100000:3.0:1788846006.783838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:3.0:1788846006.783850:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11379:x1875740683463680:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788846006.783886:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788846006.784001:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11379:x1875740683463680:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 154us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.784009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:3.0:1788846006.790048:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.790417:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683463808 00000100:00100000:0.0:1788846006.790427:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683463808 00000100:00100000:0.0:1788846006.790493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:0.0:1788846006.790503:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11379:x1875740683463808:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788846006.790629:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790646:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790656:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790671:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790677:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790684:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790704:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790714:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790721:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846006.790762:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788846006.790766:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846006.790779:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790790:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790804:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790811:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790818:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.790822:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790829:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790852:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:0.0:1788846006.790855:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.790860:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790865:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827220e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790878:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790884:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790890:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790894:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.790902:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790908:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790915:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff90e4514bd900) 00010000:00010000:0.0:1788846006.790917:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.790920:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790925:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272215 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790936:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790941:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790946:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790951:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.790953:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790960:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790966:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:0.0:1788846006.790968:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.790975:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.790980:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827221c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.791052:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11379:x1875740683463808:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 550us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.791059:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:2.0:1788846006.794235:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.794327:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683464064 00000100:00100000:3.0:1788846006.794355:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683464064 00000100:00100000:3.0:1788846006.794425:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:3.0:1788846006.794435:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:11379:x1875740683464064:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846006.794454:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846006.794474:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272223 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546a3 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794621:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794637:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794648:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846006.794659:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788846006.794734:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794742:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794749:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794756:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846006.794759:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794767:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794787:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:3.0:1788846006.794790:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788846006.794795:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794801:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827222a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794855:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272223 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546a3 expref: 63 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794866:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:3.0:1788846006.794868:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788846006.794872:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272223 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546a3 expref: 63 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.794881:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065400, rc 0) 00000100:00100000:3.0:1788846006.794944:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11379:x1875740683464064:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 511us (724us total) trans 4294967400 rc 301/301 00000100:00100000:3.0:1788846006.794950:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:1.0:1788846006.799439:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.799768:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683464192 00000100:00100000:3.0:1788846006.799779:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683464192 00000100:00100000:3.0:1788846006.799837:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:3.0:1788846006.799856:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11379:x1875740683464192:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788846006.799910:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788846006.800017:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11379:x1875740683464192:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 163us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.800033:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:0.0:1788846006.802739:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.802861:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683464448 00000100:00100000:3.0:1788846006.802871:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683464448 00000100:00100000:3.0:1788846006.802930:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:3.0:1788846006.802940:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11379:x1875740683464448:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846006.802957:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846006.802961:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788846006.802985:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382721c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754687 expref: 62 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.803005:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:3.0:1788846006.803009:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846006.803021:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272238 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546aa expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788846006.803414:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788846006.803599:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d5613827223f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.803613:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d5613827223f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.803623:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d5613827223f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.803672:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272238 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546aa expref: 64 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.803703:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d5613827223f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546aa expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.803711:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e461481d00) 00010000:00010000:3.0:1788846006.803713:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846006.803716:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846006.803768:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:11379:x1875740683464448:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 829us (1036us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788846006.803775:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:2.0:1788846006.809810:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.809906:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683464704 00000100:00100000:0.0:1788846006.809916:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683464704 00000100:00100000:0.0:1788846006.809973:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:0.0:1788846006.809983:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:11379:x1875740683464704:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788846006.810036:0:7876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846006.810059:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d5613827223f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546aa expref: 63 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810077:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e461481d00) 00010000:00010000:0.0:1788846006.810085:0:7876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846006.810104:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810126:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810143:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810157:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810176:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810183:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810225:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810231:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810238:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810244:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.810248:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810255:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810262:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:0.0:1788846006.810265:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.810268:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810274:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d5613827224d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810283:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810293:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810299:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810303:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.810306:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810312:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810319:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x2e54aeaf (ffff90e4514bd900) 00010000:00010000:0.0:1788846006.810321:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.810323:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.810328:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272254 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2e54aeaf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.810404:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11379:x1875740683464704:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 422us (602us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788846006.810411:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1788846006.814993:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.815145:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683464832 00000100:00100000:0.0:1788846006.815155:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683464832 00000100:00100000:0.0:1788846006.815211:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:0.0:1788846006.815221:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:11379:x1875740683464832:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846006.815240:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846006.815278:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827225b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.815311:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.815324:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.815334:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.815440:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827225b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.815460:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.815469:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:0.0:1788846006.815471:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846006.815475:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356200, rc 0) 00000100:00100000:0.0:1788846006.815738:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:11379:x1875740683464832:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 516us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.815745:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:1.0:1788846006.822348:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.822410:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683465088 00000100:00100000:2.0:1788846006.822419:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683465088 00000100:00100000:2.0:1788846006.822512:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:2.0:1788846006.822569:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:11379:x1875740683465088:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788846006.822648:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.822665:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.822676:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846006.822826:0:12145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788846006.822836:0:12145:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390860315233ns, next at 391860312906ns, rc = 0 00000004:00010000:2.0:1788846006.822883:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056576e19 reply state 00000000c2be93f7 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.822916:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.822923:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:2.0:1788846006.822926:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788846006.822930:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846006.823019:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:11379:x1875740683465088:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 498us (679us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788846006.823027:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:1.0:1788846006.826241:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.827018:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683465216 00000100:00100000:0.0:1788846006.827028:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683465216 00000100:00100000:0.0:1788846006.827088:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:0.0:1788846006.827098:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:11379:x1875740683465216:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846006.827130:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846006.827169:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546b8 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.827224:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 66 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.827239:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 66 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.827256:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:0.0:1788846006.827259:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846006.827262:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356400, rc 0) 00000100:00100000:0.0:1788846006.827316:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:11379:x1875740683465216:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 219us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.827323:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:3.0:1788846006.832392:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.832420:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683465344 00000100:00100000:3.0:1788846006.832429:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683465344 00000100:00100000:3.0:1788846006.832494:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1788846006.832504:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2401:x1875740683465344:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788846006.833218:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846006.833939:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2401:x1875740683465344:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 1432us (1551us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788846006.833949:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:3.0:1788846006.836314:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.836402:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683465600 00000100:00100000:2.0:1788846006.836412:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683465600 00000100:00100000:2.0:1788846006.836466:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1788846006.836477:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:11379:x1875740683465600:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788846006.836715:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:11379:x1875740683465600:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 239us (407us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788846006.836722:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:2.0:1788846006.838958:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.839044:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683465856 00000100:00100000:3.0:1788846006.839053:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683465856 00000100:00100000:3.0:1788846006.839116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:3.0:1788846006.839126:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:11379:x1875740683465856:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788846006.839237:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:11379:x1875740683465856:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 111us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.839262:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:3.0:1788846006.842633:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846006.842799:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683465984 00000100:00100000:1.0:1788846006.842808:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683465984 00000100:00100000:1.0:1788846006.842871:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:1.0:1788846006.842881:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:11379:x1875740683465984:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788846006.842907:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846006.842928:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138272277 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546bf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.842994:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827227e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.843007:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827227e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.843019:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827227e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846006.843062:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846006.843080:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827227e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.843106:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138272277 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546bf expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.843142:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827227e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546bf expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.843151:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:1.0:1788846006.843154:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788846006.843157:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3c00, rc 0) 00000100:00100000:1.0:1788846006.843219:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:11379:x1875740683465984:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 340us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846006.843226:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:2.0:1788846006.846586:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846006.846703:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683466112 00000100:00100000:1.0:1788846006.846713:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683466112 00000100:00100000:1.0:1788846006.846758:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:1.0:1788846006.846767:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683466112:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788846006.846783:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846006.846803:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546c6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788846006.846828:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9fb7, blocks: 0x0 00010000:00010000:1.0:1788846006.846846:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788846006.846851:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846006.846860:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.846877:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.846890:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2e00, rc 0) 00000100:00100000:1.0:1788846006.846950:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:2398:x1875740683466112:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 184us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846006.846958:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1788846006.851600:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846006.852304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683466368 00000100:00100000:1.0:1788846006.852316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683466368 00000100:00100000:2.0:1788846006.852463:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:2.0:1788846006.852474:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:11379:x1875740683466368:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788846006.852773:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:11379:x1875740683466368:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 298us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.852782:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1788846006.856658:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.856946:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683466496 00000100:00100000:2.0:1788846006.856981:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683466496 00000100:00100000:2.0:1788846006.857038:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:2.0:1788846006.857049:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:11379:x1875740683466496:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846006.857076:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846006.857093:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546cd expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.857147:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.857157:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846006.857161:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846006.857167:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.857199:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.857213:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 11 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.857227:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875740702408064:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846006.857322:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846006.862703:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846006.862794:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683466624 00000100:00100000:1.0:1788846006.862803:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683466624 00010000:00010000:1.0:1788846006.862854:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 12 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.862915:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:1.0:1788846006.862925:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:2398:x1875740683466624:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846006.862940:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846006.862971:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 12 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.862986:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 12 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.863010:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846006.863014:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846006.863022:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.863033:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.863069:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.863083:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f595500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875740702408192:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846006.863180:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541000 going to sleep for 11 seconds 00010000:00010000:2.0:1788846006.867057:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052f74aa0/0x21b4d56138272285 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546c6 expref: 12 pid: 8430 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.867103:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875740702408064:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846006.867154:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.867168:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031400, rc 0) 00000100:00100000:2.0:1788846006.867344:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:11379:x1875740683466496:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 10297us (10694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.867353:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1788846006.872002:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.872063:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683466752 00000100:00100000:3.0:1788846006.872071:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683466752 00002000:00100000:3.0:1788846006.872180:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90e3439e5500 x1875740683466752/t0(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:357/0 lens 504/0 e 0 to 0 dl 1788846017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788846006.872193:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e3439e5500 with x1875740683466752 ext(0->12) 00002000:00010000:3.0:1788846006.872199:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e3439e5500 00000100:00100000:1.0:1788846006.872243:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f595500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875740702408192:192.168.203.20@tcp:105: 00000100:00100000:3.0:1788846006.872263:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:3.0:1788846006.872275:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:2398:x1875740683466752:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00010000:00010000:1.0:1788846006.872286:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846006.872343:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:2398:x1875740683466624:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 9419us (9648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846006.872353:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:3.0:1788846006.874460:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:2398:x1875740683466752:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 2180us (2510us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788846006.874472:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00002000:00100000:3.0:1788846006.874483:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff90e3439e5500 x1875740683466752/t4294967309(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:357/0 lens 504/448 e 0 to 0 dl 1788846017 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788846006.874493:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e3439e5500 with x1875740683466752 ext(0->12) 00002000:00010000:3.0:1788846006.874499:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e3439e5500 00000100:00100000:0.0:1788846006.878661:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.878730:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683466880 00000100:00100000:2.0:1788846006.878741:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683466880 00000100:00100000:2.0:1788846006.878796:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:2.0:1788846006.878805:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:11379:x1875740683466880:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788846006.881184:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:3.0:1788846006.881199:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788846006.881232:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788846006.881256:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e4484df6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788846006.881270:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e447f94d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e4484dff00 00000020:00080000:3.0:1788846006.881273:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e447f94800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e461dbaa00 00000004:00080000:3.0:1788846006.881297:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788846006.881324:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e47d196180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788846006.881327:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d3a9900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e47d196d80 00000020:00080000:3.0:1788846006.881330:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d3a9d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e343b1ae00 00000020:00080000:3.0:1788846006.881339:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788846006.881471:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11379:x1875740683466880:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 2662us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.881479:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:1.0:1788846006.881693:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788846006.881708:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702408320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788846006.881762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846006.881804:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702408320 00000100:00100000:1.0:1788846006.881811:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702408320 00000100:00100000:1.0:1788846006.881846:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788846006.881854:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875740702408320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788846006.881877:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1788846006.881900:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.881919:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.881927:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788846006.881932:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846006.881936:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.881977:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.881991:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 11 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.882013:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f594a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875740702408576:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846006.882054:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541180 going to sleep for 11 seconds 00000100:00100000:1.0:1788846006.882067:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846006.882075:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702408448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788846006.882098:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846006.882147:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702408448 00000100:00100000:1.0:1788846006.882151:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702408448 00000100:00100000:1.0:1788846006.882176:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788846006.882182:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3643:x1875740702408448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788846006.882281:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788846006.882285:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788846007 00002000:00010000:1.0:1788846006.882287:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788846006.882289:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788846007 -> 1788846007 00002000:00010000:1.0:1788846006.882291:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788846006.882324:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3643:x1875740702408448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (224us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788846006.882330:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:1.0:1788846006.882369:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e47f595500/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788846006.882375:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702408448:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1788846006.882639:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788846006.882678:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1788846006.883040:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883051:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883058:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883065:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.883069:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883089:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883411:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:0.0:1788846006.883415:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.883420:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883428:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138271f91 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883452:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883459:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883465:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883470:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.883474:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883480:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883488:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff90e475235a00) 00010000:00010000:0.0:1788846006.883491:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.883494:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883511:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272039 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883579:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883586:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883592:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883597:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.883600:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883606:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883615:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481600) 00010000:00010000:0.0:1788846006.883617:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.883621:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883626:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382720b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883637:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883644:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883655:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883661:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.883664:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883670:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883678:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e461481600) 00010000:00010000:0.0:1788846006.883681:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.883684:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883689:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382720da lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883704:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883710:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883716:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883721:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.883724:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883738:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883747:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:0.0:1788846006.883749:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846006.883752:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883757:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d561382721ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883768:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883774:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883780:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883784:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.883787:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883792:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883799:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:0.0:1788846006.883802:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788846006.883804:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.883819:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272269 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.883933:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702408704:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788846006.883995:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846006.884203:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702408704 00000100:00100000:3.0:1788846006.884211:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702408704 00000100:00100000:3.0:1788846006.884257:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788846006.884267:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3643:x1875740702408704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788846006.884289:0:8906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1788846006.884317:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f9fb6, atime: 0x6a9f9fb6, ctime: 0x6a9f9fb6, blocks: 0x8 00010000:00010000:3.0:1788846006.884324:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.884343:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1788846006.884348:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846006.884354:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.884367:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.884387:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.884394:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.884418:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788846006.884897:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3643:x1875740702408704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 630us (899us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788846006.884905:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1788846006.885219:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e3439c7100/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788846006.885228:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702408704:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788846006.885310:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846006.885318:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.885328:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846006.885332:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.885341:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.885359:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.885366:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d5613827229a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.885385:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846006.885387:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846006.885388:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846006.888938:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.889046:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683467008 00000100:00100000:0.0:1788846006.889055:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683467008 00000100:00100000:0.0:1788846006.889115:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:0.0:1788846006.889125:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:2399:x1875740683467008:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788846006.890539:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788846006.890554:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788846006.890670:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683467008:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 1542us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.890679:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:1.0:1788846006.891916:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f594a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875740702408576:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846006.891967:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.893161:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.893350:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683467136 00000100:00100000:3.0:1788846006.893359:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683467136 00010000:00010000:3.0:1788846006.893398:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 7 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846006.893433:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 74 00000100:00100000:3.0:1788846006.893442:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683467136:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846006.893456:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846006.893462:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 7 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.893475:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 7 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.893498:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272047 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754625 expref: 7 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.893570:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846006.893576:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846006.893581:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.893590:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846006.893612:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846006.893664:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683467136:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 222us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.893672:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 74 00010000:00010000:1.0:1788846006.894556:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.894578:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.894588:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.894595:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.894623:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788846006.894799:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875740702408320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12944us (13034us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788846006.894806:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1788846006.894882:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846006.894889:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.894898:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846006.894903:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.894927:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.894944:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.894963:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1936e76/0x21b4d56138272293 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.894984:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846006.894985:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846006.894987:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846006.895325:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788846006.895332:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788846006.895350:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e47f595500, transno 4294967310 00000100:00100000:3.0:1788846006.895361:0:3640:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90e47f594700 x1875740702408320/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788846022 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788846006.895371:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e47f594700/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788846006.895376:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702408320:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788846006.897634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.897744:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683467392 00000100:00100000:2.0:1788846006.897753:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683467392 00000100:00100000:2.0:1788846006.897801:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:2.0:1788846006.897811:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:11379:x1875740683467392:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788846006.897871:0:12145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846006.897897:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827227e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546bf expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.897915:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:2.0:1788846006.897921:0:12145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846006.897961:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.897974:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.897995:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846006.898097:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000591bc21 reply state 000000000bc0766c transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.898110:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.898116:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:2.0:1788846006.898119:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846006.898121:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846006.898233:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:11379:x1875740683467392:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 423us (605us total) trans 4294967404 rc 0/0 00000100:00100000:2.0:1788846006.898240:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:2.0:1788846006.901637:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846006.902245:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683467520 00000100:00100000:1.0:1788846006.902255:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683467520 00000100:00100000:1.0:1788846006.902317:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:1.0:1788846006.902327:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683467520:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788846006.902461:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788846006.902466:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788846007 -> 1788846006 00002000:00010000:1.0:1788846006.902468:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788846006 00002000:00010000:1.0:1788846006.902483:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788846007 -> 1788846006 00002000:00010000:1.0:1788846006.902485:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788846006.902721:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683467520:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 394us (2209us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788846006.902729:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:0.0:1788846006.909717:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.910591:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683467776 00000100:00100000:2.0:1788846006.910612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683467776 00000100:00100000:2.0:1788846006.910719:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:2.0:1788846006.910730:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:11379:x1875740683467776:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788846006.910795:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.910823:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.910840:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.910889:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.910904:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 17 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.910918:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702408832:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846006.911002:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80840 going to sleep for 11 seconds 00000100:00100000:2.0:1788846006.917363:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702408832:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846006.917393:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.918403:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.918473:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683467904 00000100:00100000:2.0:1788846006.918482:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683467904 00010000:00010000:2.0:1788846006.918516:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 18 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.918580:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 75 00000100:00100000:2.0:1788846006.918590:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+18:2399:x1875740683467904:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846006.918614:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846006.918622:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 18 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.918636:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 18 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.918676:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d56138272262 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b1 expref: 18 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.918691:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:2.0:1788846006.918696:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.918705:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.918712:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.918742:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846006.918789:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:2399:x1875740683467904:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 201us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.918797:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 75 00010000:00010000:0.0:1788846006.919755:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.919766:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.919804:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.919811:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.919817:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.919836:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846006.919840:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.919847:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.919860:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:0.0:1788846006.919873:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788846006.919878:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.919884:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.919959:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:11379:x1875740683467776:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 9229us (10249us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788846006.919969:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:3.0:1788846006.924697:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.924947:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683468032 00000100:00100000:2.0:1788846006.924958:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683468032 00000100:00100000:2.0:1788846006.925201:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:2.0:1788846006.925213:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683468032:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788846006.925256:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.925276:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.925304:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846006.925309:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788846006.925314:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.925348:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.925362:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 7 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.925388:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875740702408960:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846006.925474:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80840 going to sleep for 11 seconds 00000100:00100000:3.0:1788846006.935001:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.935335:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683468160 00000100:00100000:0.0:1788846006.935345:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683468160 00010000:00010000:0.0:1788846006.935383:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 8 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.935431:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:0.0:1788846006.935442:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683468160:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846006.935456:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846006.935476:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 8 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.935491:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 8 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.935544:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846006.935550:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846006.935557:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.935826:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.935849:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846006.935912:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683468160:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 471us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.935919:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00010000:00010000:2.0:1788846006.936482:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d5613827228c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546cd expref: 7 pid: 8433 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.936502:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875740702408960:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846006.936684:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936696:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936703:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936738:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936746:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936753:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936760:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846006.936764:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936773:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936785:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.936792:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d561382722af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.937973:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683468032:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 12755us (13277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.937985:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1788846006.945691:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.945864:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683468416 00000100:00100000:2.0:1788846006.945874:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683468416 00000100:00100000:2.0:1788846006.945931:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:2.0:1788846006.945941:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:11379:x1875740683468416:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788846006.946013:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.946031:0:7876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.946042:0:7876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.946074:0:7876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.946089:0:7876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 16 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.946104:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702409088:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846006.946199:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80840 going to sleep for 11 seconds 00000100:00100000:3.0:1788846006.959794:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.960024:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683468544 00000100:00100000:0.0:1788846006.960034:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683468544 00010000:00010000:0.0:1788846006.960072:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 17 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.960115:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:0.0:1788846006.960125:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:2398:x1875740683468544:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846006.960149:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846006.960157:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 17 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.960171:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 17 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.960192:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:0.0:1788846006.960197:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 17 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.960224:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.960232:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.960240:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.960257:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846006.960309:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:2398:x1875740683468544:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 185us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.960316:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00010000:00010000:2.0:1788846006.960577:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382721a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754679 expref: 16 pid: 6517 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.960594:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702409088:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846006.960627:0:7876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.960647:0:7876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.960653:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.960808:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.960834:0:7876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 16 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.960843:0:7876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.960872:0:7876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 16 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.960887:0:7876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 16 pid: 7876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.960900:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702409216:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846006.960955:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d809c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846006.965811:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.965974:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683468672 00000100:00100000:0.0:1788846006.965984:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683468672 00010000:00010000:0.0:1788846006.966022:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 17 pid: 7876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846006.966069:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:0.0:1788846006.966080:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:2399:x1875740683468672:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846006.966094:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846006.966100:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 17 pid: 7876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.966114:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 17 pid: 7876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.966162:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:0.0:1788846006.966168:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.966177:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.966184:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.966203:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846006.966256:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:2399:x1875740683468672:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 178us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.966264:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00010000:00010000:2.0:1788846006.966774:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272270 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546b8 expref: 16 pid: 7876 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846006.966793:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702409216:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846006.966815:0:7876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.966907:0:7876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846006.966913:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846006.967014:0:7876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788846006.967123:0:7876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1788846006.967171:0:7876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788846006.967249:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7876:1875740702409344:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788846006.967303:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846006.967326:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846006.967731:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702409344 00000100:00100000:0.0:1788846006.967739:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702409344 00000100:00100000:0.0:1788846006.967785:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788846006.967793:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7876:x1875740702409344:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788846006.967984:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7876:x1875740702409344:12345-0@lo:1000:mdt00_003.0 Request processed in 190us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846006.967992:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788846006.968082:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7876:1875740702409344:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788846006.968220:0:7876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:1.0:1788846006.968269:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f594a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7876:1875740702409472:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788846006.968304:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846006.968338:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846006.968461:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702409472 00000100:00100000:0.0:1788846006.968467:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702409472 00000100:00100000:0.0:1788846006.968501:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788846006.968508:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7876:x1875740702409472:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788846006.969967:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7876:x1875740702409472:12345-0@lo:1000:mdt00_003.0 Request processed in 1454us (1656us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788846006.969990:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788846006.973258:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f594a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7876:1875740702409472:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788846006.973315:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973454:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973462:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973468:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846006.973473:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973481:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973495:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:1.0:1788846006.973511:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788846006.973516:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973739:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382722bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973770:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973776:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973781:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973786:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846006.973789:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973795:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973804:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846006.973806:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788846006.973814:0:7876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 19 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973895:0:7876:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 19 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973906:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 19 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.973956:0:7876:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 19 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.973969:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344440000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702409600:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846006.974148:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e45a021300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846006.982962:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846006.983109:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683468800 00000100:00100000:2.0:1788846006.983127:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683468800 00000100:00100000:2.0:1788846006.983227:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:2.0:1788846006.983238:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:11378:x1875740683468800:12345-192.168.203.20@tcp:49:lfs.0 00000100:00100000:2.0:1788846006.983361:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:11378:x1875740683468800:12345-192.168.203.20@tcp:49:lfs.0 Request processed in 125us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846006.983369:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:1.0:1788846006.983910:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344440000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702409600:192.168.203.20@tcp:105: 00010000:00010000:1.0:1788846006.983933:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.983944:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272200 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.983979:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.983992:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984003:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984012:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984018:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984035:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984059:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846006.984064:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984071:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984083:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846006.984086:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846006.984089:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984095:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d561382722c4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984114:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984121:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984127:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984132:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846006.984143:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984149:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984168:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846006.984171:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788846006.984174:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.984180:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382722b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846006.984318:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:11379:x1875740683468416:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 38377us (38635us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788846006.984326:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 139 00000020:00080000:1.0:1788846006.984331:0:7876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788846006.984619:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788846006.984624:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846006.985100:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788846006.985109:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788846006.989059:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846006.994000:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683469056 00000100:00100000:0.0:1788846006.994015:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683469056 00000100:00100000:0.0:1788846006.994070:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:0.0:1788846006.994080:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:11379:x1875740683469056:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788846006.994337:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788846006.994367:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:0.0:1788846006.994398:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.994414:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.994425:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.994433:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.994439:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846006.994445:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846006.994643:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846006.994670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683469312 00000100:00100000:3.0:1788846006.994675:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683469312 00000100:00100000:3.0:1788846006.994708:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:3.0:1788846006.994716:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11378:x1875740683469312:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:0.0:1788846006.995411:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788846006.995506:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11379:x1875740683469056:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 1426us (6455us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788846006.995514:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000020:00080000:0.0:1788846006.995546:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1788846006.995729:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788846006.995955:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:11378:x1875740683469312:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 1237us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846006.995964:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 140 00010000:00010000:1.0:1788846006.996307:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846006.996316:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.996326:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846006.996331:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.996339:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.996353:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:1.0:1788846006.996356:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788846006.996361:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.996368:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382722cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846006.996394:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846006.996396:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846006.996398:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846007.042187:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846007.042320:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683469440 00000100:00100000:0.0:1788846007.042330:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683469440 00000100:00100000:0.0:1788846007.042591:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:0.0:1788846007.042603:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:11381:x1875740683469440:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846007.042626:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846007.042645:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382722d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546d4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042718:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042733:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042744:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042759:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042766:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042772:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042857:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042873:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042901:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042933:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846007.042946:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 22 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846007.042959:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702409728:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846007.043052:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9900 going to sleep for 11 seconds 00000100:00080000:2.0:1788846007.043120:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846007.052031:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846007.052103:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683469696 00000100:00100000:1.0:1788846007.052113:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683469696 00000100:00100000:1.0:1788846007.052183:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:1.0:1788846007.052194:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:6166:x1875740683469696:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788846007.052425:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:6166:x1875740683469696:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 232us (401us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788846007.052433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:2.0:1788846007.052828:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702409728:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846007.052850:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846007.058571:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846007.058702:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683469824 00000100:00100000:2.0:1788846007.058715:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683469824 00010000:00010000:3.0:1788846007.058909:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 24 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846007.058953:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:3.0:1788846007.058963:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:2398:x1875740683469824:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846007.058977:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846007.058984:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 24 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846007.058997:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 24 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846007.059019:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d561382721f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754695 expref: 24 pid: 6516 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846007.059057:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:3.0:1788846007.059062:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846007.059071:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846007.059078:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846007.059110:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846007.059177:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:2398:x1875740683469824:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 215us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846007.059186:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00010000:00010000:2.0:1788846007.059311:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059328:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846007.059378:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788846007.059383:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846007.059402:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059414:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059424:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059431:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059437:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059444:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846007.059448:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059456:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059466:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:2.0:1788846007.059470:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846007.059473:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059490:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059502:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059508:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059514:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059627:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846007.059631:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059637:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059646:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff90e4514bd800) 00010000:00010000:2.0:1788846007.059649:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846007.059652:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059658:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382722e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059703:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d561382722d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546d4 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059720:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546d4 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846007.059734:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:2.0:1788846007.059736:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846007.059739:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356e00, rc 0) 00000100:00100000:2.0:1788846007.059782:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11381:x1875740683469440:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 17181us (17602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846007.059790:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 141 00010000:00010000:0.0:1788846007.101493:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788846007.500913:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788846007.500927:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788846007.664480:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846007.664626:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683470080 00000100:00100000:2.0:1788846007.664635:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683470080 00000100:00100000:2.0:1788846007.664693:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 271 00000100:00100000:2.0:1788846007.664703:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683470080:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846007.664772:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683470080:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846007.664779:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 271 00000100:00080000:2.0:1788846007.664801:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846007.664886:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846007.664913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846007.664941:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846007.664960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846007.664985:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846007.665018:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683470336 00000100:00100000:0.0:1788846007.665023:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683470336 00000100:00100000:0.0:1788846007.665050:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683470208 00000100:00100000:0.0:1788846007.665053:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683470208 00000100:00100000:0.0:1788846007.665074:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:0.0:1788846007.665081:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683470336:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846007.665113:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683470336:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846007.665127:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:0.0:1788846007.665152:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:0.0:1788846007.665160:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683470208:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846007.665184:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f595180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683470208:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846007.665190:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:0.0:1788846007.665206:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683470592 00000100:00100000:0.0:1788846007.665210:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683470592 00000100:00100000:0.0:1788846007.665230:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683470464 00000100:00100000:0.0:1788846007.665233:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683470464 00000100:00100000:0.0:1788846007.665248:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 272 00000100:00100000:0.0:1788846007.665254:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683470592:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846007.665279:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683470592:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846007.665285:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 272 00000100:00100000:0.0:1788846007.665297:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 273 00000100:00100000:0.0:1788846007.665302:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683470464:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846007.665323:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683470464:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 21us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846007.665328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 273 00000100:00100000:2.0:1788846007.665892:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683469952 00000100:00100000:2.0:1788846007.665897:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683469952 00000100:00100000:2.0:1788846007.665928:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 380 00000100:00100000:2.0:1788846007.665934:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683469952:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846007.665966:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683469952:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846007.665972:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 380 00000100:00080000:2.0:1788846007.666007:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788846007.666010:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788846007.666020:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788846007.999456:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788846007.999465:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788846007.999662:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788846007.999670:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788846007.999807:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450c1b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702409856:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788846007.999895:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9780 going to sleep for 11 seconds 00000040:00080000:3.0:1788846008.005825:0:14255:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788846008.005834:0:14255:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846008.005867:0:14255:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788846008.005873:0:14255:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788846008.007777:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450c1b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702409856:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788846008.012000:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846008.012189:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683470720 00000100:00100000:2.0:1788846008.012198:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683470720 00000100:00100000:2.0:1788846008.012255:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:2.0:1788846008.012264:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11392:x1875740683470720:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788846008.012297:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788846008.012409:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11392:x1875740683470720:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 145us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846008.012417:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:0.0:1788846008.034257:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846008.034298:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683470976 00000100:00100000:0.0:1788846008.034308:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683470976 00000100:00100000:0.0:1788846008.034361:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:0.0:1788846008.034371:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:11392:x1875740683470976:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846008.034393:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846008.034410:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546db expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.034515:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382722f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.034565:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382722f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.034579:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382722f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846008.034590:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788846008.034690:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356200/0x21b4d561382722ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546db expref: 25 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.034708:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382722f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546db expref: 24 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.034732:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:0.0:1788846008.034735:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846008.034738:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356a00, rc 0) 00000100:00100000:0.0:1788846008.034791:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:11392:x1875740683470976:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 420us (542us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788846008.034798:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:1.0:1788846008.047306:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846008.047710:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846008.047741:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683471360 00000100:00100000:1.0:1788846008.047751:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683471360 00000100:00100000:1.0:1788846008.047803:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:1.0:1788846008.047812:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:11392:x1875740683471360:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788846008.047884:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.047900:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.047913:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.049304:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.049322:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.049330:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.049336:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846008.049340:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.049348:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.049363:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846008.049366:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788846008.050097:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846008.050178:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d56138272303 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846008.050316:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:11392:x1875740683471360:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 2500us (2602us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788846008.050328:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 144 00000100:00100000:0.0:1788846008.050697:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683471104 00000100:00100000:0.0:1788846008.050704:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683471104 00000100:00100000:0.0:1788846008.050753:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:0.0:1788846008.050761:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:2400:x1875740683471104:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846008.050774:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846008.050791:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382722f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546db expref: 25 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846008.050805:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:0.0:1788846008.050809:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846008.050831:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:2400:x1875740683471104:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 71us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846008.050837:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000040:00080000:0.0:1788846008.050962:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788846008.050966:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788846008.051485:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788846008.051493:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788846008.058077:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846008.058272:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683471616 00000100:00100000:3.0:1788846008.058280:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683471616 00000100:00100000:3.0:1788846008.058331:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:3.0:1788846008.058340:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:11392:x1875740683471616:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788846008.058779:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:11392:x1875740683471616:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 438us (707us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788846008.058789:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00010000:00010000:2.0:1788846008.122172:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846008.123160:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702409984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846008.123233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846008.123546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702409984 00000100:00100000:2.0:1788846008.123554:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702409984 00000100:00100000:2.0:1788846008.123613:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788846008.123623:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702409984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846008.123655:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788846008.123705:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702409984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846008.123712:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788846008.123758:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702409984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788846009.147473:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788846010.007474:0:14307:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788846010.007483:0:14307:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788846010.007517:0:14307:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788846010.010485:0:14307:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788846010.175631:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846010.183802:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846010.183879:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683471872 00000100:00100000:2.0:1788846010.183888:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683471872 00000100:00100000:2.0:1788846010.183956:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:2.0:1788846010.183967:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:11414:x1875740683471872:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846010.183991:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846010.184012:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827230a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546e2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846010.184150:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272311 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846010.184165:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272311 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846010.184176:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272311 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846010.184187:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788846010.184285:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827230a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546e2 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846010.184300:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272311 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546e2 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846010.184308:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:2.0:1788846010.184311:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788846010.184314:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031400, rc 0) 00000100:00100000:2.0:1788846010.184370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:11414:x1875740683471872:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 406us (577us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788846010.184377:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00080000:3.0:1788846010.184637:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846010.192613:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846010.192699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683472000 00000100:00100000:2.0:1788846010.192709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683472000 00000100:00100000:1.0:1788846010.192853:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:1.0:1788846010.192867:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:11414:x1875740683472000:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1788846010.192935:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.192952:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.192963:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.192994:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.193000:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.193007:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.193012:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846010.193016:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.193024:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.193034:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846010.193037:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846010.193053:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846010.193066:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d5613827231f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846010.193146:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:11414:x1875740683472000:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 283us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846010.193154:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:2.0:1788846010.326057:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846010.326628:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683472128 00000100:00100000:0.0:1788846010.326640:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683472128 00000100:00100000:0.0:1788846010.326730:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:0.0:1788846010.326742:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683472128:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:0.0:1788846010.326760:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846010.326792:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272326 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546e9 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846010.326817:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9fb6, atime: 0x6a9f9fb6, ctime: 0x6a9f9fb6, blocks: 0x8 00010000:00010000:0.0:1788846010.326839:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1788846010.326843:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846010.326855:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546e9 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846010.326876:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546e9 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846010.326889:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356200, rc 0) 00000100:00100000:0.0:1788846010.326955:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2401:x1875740683472128:12345-192.168.203.20@tcp:101:cat.0 Request processed in 215us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846010.326963:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00080000:3.0:1788846010.327291:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846010.331603:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846010.332131:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683472256 00000100:00100000:0.0:1788846010.332151:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683472256 00002000:00100000:0.0:1788846010.332202:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff90e3439d5c00 x1875740683472256/t0(0) o3->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:361/0 lens 488/0 e 0 to 0 dl 1788846021 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788846010.332214:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e3439d5c00 with x1875740683472256 ext(0->4095) 00002000:00010000:0.0:1788846010.332220:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e3439d5c00 00000100:00100000:0.0:1788846010.332255:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1788846010.332282:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2401:x1875740683472256:12345-192.168.203.20@tcp:3:cat.0 00000100:00100000:0.0:1788846010.332511:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2401:x1875740683472256:12345-192.168.203.20@tcp:3:cat.0 Request processed in 231us (915us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788846010.332548:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00002000:00100000:0.0:1788846010.332555:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff90e3439d5c00 x1875740683472256/t0(0) o3->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:361/0 lens 488/4536 e 0 to 0 dl 1788846021 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788846010.332563:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e3439d5c00 with x1875740683472256 ext(0->4095) 00002000:00010000:0.0:1788846010.332567:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e3439d5c00 00000100:00100000:1.0:1788846010.683801:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702410240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846010.683871:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846010.683957:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702410240 00000100:00100000:1.0:1788846010.683964:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702410240 00000100:00100000:1.0:1788846010.684028:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788846010.684037:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702410240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788846010.684065:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846010.684130:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702410240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846010.684137:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788846010.684173:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788846010.684178:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1788846010.684198:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e343b2d180, transno 4294967302 00000004:00080000:1.0:1788846010.684206:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788846010.684218:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e3439c7100, transno 4294967305 00000100:00100000:1.0:1788846010.684228:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702410240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846010.684627:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702410112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846010.684675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788846010.684719:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846010.684729:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702410112 00000100:00100000:3.0:1788846010.684733:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702410112 00000100:00100000:3.0:1788846010.684775:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788846010.684781:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702410112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788846010.684793:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788846010.684824:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702410112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846010.684830:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788846010.684862:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702410112:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788846010.685088:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788846011.196061:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846011.196328:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702410496:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.196392:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.196440:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702411008:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.196465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.196485:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702411520:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.196506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.196568:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788846011.196575:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702410624:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.196600:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.196630:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702411136:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.196652:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.196666:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702411648:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.196685:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.196714:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702410624 00000100:00100000:3.0:1788846011.196721:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702410624 00000100:00100000:3.0:1788846011.196765:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788846011.196773:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702410624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.196824:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702410624:12345-0@lo:400:kworker.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846011.196831:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788846011.196886:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702410624:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197008:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702410496 00000100:00100000:1.0:1788846011.197012:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702410496 00000100:00100000:1.0:1788846011.197035:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702411008 00000100:00100000:1.0:1788846011.197044:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702411008 00000100:00100000:1.0:1788846011.197068:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702411520 00000100:00100000:1.0:1788846011.197071:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702411520 00000100:00100000:1.0:1788846011.197095:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702411136 00000100:00100000:1.0:1788846011.197098:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702411136 00000100:00100000:1.0:1788846011.197123:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702411648 00000100:00100000:1.0:1788846011.197126:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702411648 00000100:00100000:1.0:1788846011.197142:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788846011.197148:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702410496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197184:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702410496:12345-0@lo:400:kworker.0 Request processed in 36us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.197190:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788846011.197204:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788846011.197209:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702411008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197237:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702411008:12345-0@lo:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.197243:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788846011.197254:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788846011.197260:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702411520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197285:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702411520:12345-0@lo:400:kworker.0 Request processed in 26us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.197291:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788846011.197301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788846011.197307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702411136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197333:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702411136:12345-0@lo:400:kworker.0 Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.197339:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788846011.197362:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788846011.197367:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702411648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197396:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702411648:12345-0@lo:400:kworker.0 Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.197402:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788846011.197423:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846011.197432:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702412032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846011.197459:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788846011.197483:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846011.197487:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846011.197495:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702410752:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197516:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.197560:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702411264:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197586:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.197604:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702411776:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.197642:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788846011.197647:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702410368:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197671:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.197691:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702410880:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197710:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.197723:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702411392:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.197760:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702411904:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197777:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846011.197806:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702411264 00000100:00100000:1.0:1788846011.197810:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702411264 00000100:00100000:1.0:1788846011.197829:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702411776 00000100:00100000:1.0:1788846011.197832:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702411776 00000100:00100000:1.0:1788846011.197848:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702411392 00000100:00100000:1.0:1788846011.197851:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702411392 00000100:00100000:1.0:1788846011.197860:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702411904 00000100:00100000:1.0:1788846011.197862:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702411904 00000100:00100000:1.0:1788846011.197874:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788846011.197880:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702411264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.197916:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475f71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702411264:12345-0@lo:400:kworker.0 Request processed in 36us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.197922:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788846011.198039:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788846011.198045:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702411776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.198071:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702411776:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.198077:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788846011.198088:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788846011.198094:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702411392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.198136:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702411392:12345-0@lo:400:kworker.0 Request processed in 43us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.198142:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788846011.198152:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788846011.198157:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875740702411904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.198181:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875740702411904:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.198197:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1788846011.198219:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788846011.198226:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702410752 00000100:00100000:1.0:1788846011.198229:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702410752 00000100:00100000:1.0:1788846011.198250:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788846011.198256:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702410752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.198286:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702410752:12345-0@lo:400:kworker.0 Request processed in 30us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846011.198292:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788846011.198323:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702411392:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.198332:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702411904:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.198341:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702410752:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.198349:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702411264:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.198357:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702411776:0@lo:400:kworker.0 00000100:00100000:2.0:1788846011.198560:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702412032 00000100:00100000:2.0:1788846011.198565:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702412032 00000100:00100000:2.0:1788846011.198591:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702410880 00000100:00100000:2.0:1788846011.198594:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702410880 00000100:00100000:2.0:1788846011.198607:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788846011.198612:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702412032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846011.198636:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788846011.198681:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702412032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846011.198688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788846011.198701:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788846011.198707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702410880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846011.198740:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702410880:12345-0@lo:400:kworker.0 Request processed in 33us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846011.198745:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788846011.198765:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702410368 00000100:00100000:2.0:1788846011.198769:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702410368 00000100:00100000:2.0:1788846011.198794:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788846011.198800:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702410368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846011.198828:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702410368:12345-0@lo:400:kworker.0 Request processed in 27us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846011.198834:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788846011.198871:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702410368:0@lo:400:kworker.0 00000100:00100000:2.0:1788846011.198881:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702410880:0@lo:400:kworker.0 00010000:00080000:3.0:1788846011.199548:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3439d4700 x1875740702411136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846011.199561:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702411136:0@lo:400:kworker.0 00010000:00080000:3.0:1788846011.199573:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3444eed80 x1875740702411648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846011.199581:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702411648:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.199592:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702410496:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.199603:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702411008:0@lo:400:kworker.0 00000100:00100000:3.0:1788846011.199612:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702411520:0@lo:400:kworker.0 00000100:00100000:1.0:1788846011.201784:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702412032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846011.709221:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702412160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846011.709300:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846011.709995:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702412160 00000100:00100000:3.0:1788846011.710005:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702412160 00000100:00100000:3.0:1788846011.710075:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788846011.710085:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702412160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846011.710124:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788846011.710195:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702412160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846011.710202:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788846011.710229:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702412160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846011.714689:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788846011.714713:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702412288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846011.714783:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846011.714885:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702412288 00000100:00100000:2.0:1788846011.714893:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702412288 00000100:00100000:2.0:1788846011.714939:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788846011.714948:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702412288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788846011.714976:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788846011.715038:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702412288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846011.715045:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788846011.715189:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702412288:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788846012.218845:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788846012.735853:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788846012.735887:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e449541180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788846012.735893:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e447f94900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e4495410c0 00000020:00080000:3.0:1788846012.735896:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e447f94300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e4500d5000 00000020:00080000:3.0:1788846012.735922:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788846012.735979:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788846012.736040:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788846012.736139:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846012.736151:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846012.736157:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846012.736163:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846012.736168:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846012.736185:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846012.736202:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff90e4514bd200) 00010000:00010000:0.0:1788846012.736205:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846012.736209:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846012.736215:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382722a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788846012.743244:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788846012.743259:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1788846012.784462:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846012.784506:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846012.784580:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846012.784582:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683472768 00000100:00100000:0.0:1788846012.784601:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683472768 00000100:00100000:2.0:1788846012.784608:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846012.784636:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846012.784660:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846012.784664:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:0.0:1788846012.784676:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683472768:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846012.784690:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846012.784715:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683472384 00000100:00100000:2.0:1788846012.784719:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683472384 00000100:00100000:2.0:1788846012.784754:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 382 00000100:00100000:0.0:1788846012.784759:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683472768:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846012.784767:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683472384:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846012.784770:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 110 00000100:00100000:0.0:1788846012.784791:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683472896 00000100:00100000:0.0:1788846012.784794:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683472896 00000100:00100000:2.0:1788846012.784803:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683472384:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 39us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846012.784811:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 382 00000100:00100000:0.0:1788846012.784825:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:0.0:1788846012.784834:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683472896:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846012.784844:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683472512 00000100:00100000:2.0:1788846012.784849:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683472512 00000100:00100000:0.0:1788846012.784862:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683472896:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846012.784870:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 111 00000100:00100000:2.0:1788846012.784882:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683473024 00000100:00100000:2.0:1788846012.784885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683473024 00000100:00100000:2.0:1788846012.784902:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683472640 00000100:00100000:2.0:1788846012.784904:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683472640 00000100:00100000:2.0:1788846012.784918:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 280 00000100:00100000:0.0:1788846012.784925:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683473152 00000100:00100000:2.0:1788846012.784927:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:2399:x1875740683472512:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846012.784930:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683473152 00000100:00100000:0.0:1788846012.784965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 281 00000100:00100000:0.0:1788846012.784973:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683473024:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846012.784980:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:2399:x1875740683472512:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 50us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846012.784988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 280 00000100:00100000:0.0:1788846012.785005:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683473024:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846012.785011:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 282 00000100:00100000:0.0:1788846012.785018:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 281 00000100:00100000:2.0:1788846012.785023:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683472640:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846012.785036:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 283 00000100:00100000:0.0:1788846012.785044:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683473152:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846012.785056:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683472640:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 36us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846012.785064:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 282 00000100:00100000:0.0:1788846012.785081:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683473152:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 37us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846012.785089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 283 00000100:00080000:1.0:1788846012.785159:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846012.785163:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846012.785166:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846012.785168:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788846013.243377:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846013.244278:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702412416:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846013.244347:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846013.246204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702412416 00000100:00100000:1.0:1788846013.246219:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702412416 00000100:00100000:1.0:1788846013.246279:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788846013.246308:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702412416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846013.246345:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788846013.246467:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702412416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846013.246474:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788846013.247284:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702412416:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788846014.201730:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788846014.201739:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788846014.201756:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788846014.201764:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788846014.268297:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846014.586243:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788846015.289695:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846015.784444:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846015.784547:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683473280 00000100:00100000:0.0:1788846015.784558:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683473280 00000100:00100000:0.0:1788846015.784627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:0.0:1788846015.784638:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:11067:x1875740683473280:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788846015.784792:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:11067:x1875740683473280:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 155us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846015.784800:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00080000:1.0:1788846015.784884:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846015.794346:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846015.794448:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683473408 00000100:00100000:1.0:1788846015.794459:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683473408 00000100:00100000:1.0:1788846015.794567:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:1.0:1788846015.794578:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:11067:x1875740683473408:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788846015.794689:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:11067:x1875740683473408:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 113us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846015.794696:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00080000:2.0:1788846015.794769:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846015.797240:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846015.797648:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683473664 00000100:00100000:0.0:1788846015.797658:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683473664 00000100:00100000:0.0:1788846015.797714:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1788846015.797724:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:11067:x1875740683473664:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788846015.797943:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:11067:x1875740683473664:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 219us (710us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788846015.797951:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:1.0:1788846015.802692:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846015.802712:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702412544:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788846015.802770:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846015.802826:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702412544 00000100:00100000:1.0:1788846015.802833:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702412544 00000100:00100000:1.0:1788846015.802877:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788846015.802885:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702412544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788846015.802912:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846015.802949:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702412544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846015.802955:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788846015.803131:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788846015.803141:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702412672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846015.803168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846015.803225:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702412672 00000100:00100000:0.0:1788846015.803229:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702412672 00000100:00100000:0.0:1788846015.803259:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788846015.803265:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702412672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846015.803275:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788846015.803302:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702412672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846015.803308:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788846015.803372:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702412672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846015.804125:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702412544:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788846015.804322:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846016.168175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846016.168327:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683473792 00000100:00100000:3.0:1788846016.168346:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683473792 00000100:00100000:3.0:1788846016.168415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:3.0:1788846016.168426:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:11874:x1875740683473792:12345-192.168.203.20@tcp:101:lsof.0 00010000:00010000:3.0:1788846016.168446:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846016.168557:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827232d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546f0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846016.168616:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846016.168643:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846016.168657:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846016.168701:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788846016.168705:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846016.168742:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846016.168765:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827232d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846016.168783:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846016.168792:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:3.0:1788846016.168795:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846016.168799:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064000, rc 0) 00000100:00100000:3.0:1788846016.168861:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:11874:x1875740683473792:12345-192.168.203.20@tcp:101:lsof.0 Request processed in 437us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846016.168869:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00080000:2.0:1788846016.169114:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846016.313802:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702412800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846016.313912:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846016.314026:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702412800 00000100:00100000:1.0:1788846016.314034:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702412800 00000100:00100000:1.0:1788846016.314094:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788846016.314104:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702412800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846016.314137:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788846016.314188:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702412800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846016.314195:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788846016.314238:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702412800:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788846016.314421:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846016.314606:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702413184:0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.314640:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846016.314665:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702413696:0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.314687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846016.314701:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702414208:0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.314721:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846016.314737:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788846016.314742:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702413056:0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.314760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846016.314791:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702413568:0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.314811:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846016.314823:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702414080:0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.314840:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846016.314863:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702413184 00000100:00100000:2.0:1788846016.314867:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702413184 00000100:00100000:2.0:1788846016.314892:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702413056 00000100:00100000:2.0:1788846016.314894:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702413056 00000100:00100000:2.0:1788846016.314904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702413568 00000100:00100000:2.0:1788846016.314906:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702413568 00000100:00100000:2.0:1788846016.314923:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702414080 00000100:00100000:2.0:1788846016.314925:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702414080 00000100:00100000:2.0:1788846016.314940:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788846016.314945:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702413184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.314982:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702413184:12345-0@lo:400:kworker.0 Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846016.314988:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788846016.315002:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788846016.315007:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702413056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.315031:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702413056:12345-0@lo:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846016.315037:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788846016.315047:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788846016.315052:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702413568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.315092:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702413568:12345-0@lo:400:kworker.0 Request processed in 39us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846016.315097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788846016.315116:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788846016.315122:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702414080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.315150:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702414080:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846016.315155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:2.0:1788846016.315171:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846016.315195:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702413056:0@lo:400:kworker.0 00010000:00080000:2.0:1788846016.315206:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343b2ce00 x1875740702413568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846016.315215:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702413568:0@lo:400:kworker.0 00010000:00080000:2.0:1788846016.315224:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f537480 x1875740702414080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846016.315232:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702414080:0@lo:400:kworker.0 00000100:00100000:2.0:1788846016.315240:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702413184:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315328:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702413696 00000100:00100000:0.0:1788846016.315333:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702413696 00000100:00100000:0.0:1788846016.315395:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702414208 00000100:00100000:0.0:1788846016.315399:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702414208 00000100:00100000:0.0:1788846016.315424:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788846016.315431:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702413696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315468:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702413696:12345-0@lo:400:kworker.0 Request processed in 39us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846016.315474:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788846016.315486:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788846016.315492:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702414208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315554:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702414208:12345-0@lo:400:kworker.0 Request processed in 62us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846016.315561:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788846016.315585:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702412928:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315612:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846016.315634:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702413440:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315653:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846016.315666:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702413952:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315685:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846016.315701:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788846016.315706:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702413312:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315726:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846016.315742:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702413824:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315761:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846016.315773:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702414336:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315790:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846016.315812:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702412928 00000100:00100000:0.0:1788846016.315816:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702412928 00000100:00100000:0.0:1788846016.315843:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788846016.315849:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702412928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315881:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450d7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702412928:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846016.315887:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788846016.315909:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702413312 00000100:00100000:0.0:1788846016.315912:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702413312 00000100:00100000:0.0:1788846016.315939:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788846016.315945:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702413312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.315974:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702413312:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846016.315980:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788846016.315997:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702413824 00000100:00100000:0.0:1788846016.316000:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702413824 00000100:00100000:0.0:1788846016.316016:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702414336 00000100:00100000:0.0:1788846016.316018:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702414336 00000100:00100000:0.0:1788846016.316033:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788846016.316038:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702413824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316064:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702413824:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846016.316083:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788846016.316095:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788846016.316101:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702414336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316127:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702414336:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846016.316133:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788846016.316148:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846016.316167:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702413312:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316177:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702413824:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316184:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788846016.316188:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e47f594700, transno 4294967311 00000004:00080000:0.0:1788846016.316197:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1788846016.316211:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702414336:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316228:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702412928:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316251:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702413440 00000100:00100000:0.0:1788846016.316254:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702413440 00000100:00100000:0.0:1788846016.316274:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702413952 00000100:00100000:0.0:1788846016.316277:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702413952 00000100:00100000:0.0:1788846016.316289:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788846016.316294:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702413440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316327:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702413440:12345-0@lo:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846016.316333:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788846016.316344:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788846016.316349:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702413952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316374:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f597100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702413952:12345-0@lo:400:kworker.0 Request processed in 25us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846016.316379:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:0.0:1788846016.316391:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846016.316410:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702413440:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316418:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702413952:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316438:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702413696:0@lo:400:kworker.0 00000100:00100000:0.0:1788846016.316447:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702414208:0@lo:400:kworker.0 00000100:00100000:1.0:1788846016.827123:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846016.827147:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702414464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846016.827215:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846016.827330:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702414464 00000100:00100000:3.0:1788846016.827338:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702414464 00000100:00100000:3.0:1788846016.827390:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788846016.827399:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702414464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846016.827442:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788846016.827491:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702414464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846016.827498:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788846016.827580:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702414464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846016.828004:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846016.828014:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702414592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846016.828044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846016.828451:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702414592 00000100:00100000:2.0:1788846016.828456:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702414592 00000100:00100000:2.0:1788846016.828493:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788846016.828501:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702414592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788846016.828557:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788846016.828604:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702414592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846016.828611:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788846016.828689:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702414592:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788846017.339863:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846017.905654:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846017.905697:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846017.905746:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846017.905925:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683474176 00000100:00100000:1.0:1788846017.905936:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683474176 00000100:00100000:3.0:1788846017.905973:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683474432 00000100:00100000:3.0:1788846017.905979:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683474432 00000100:00100000:1.0:1788846017.906010:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 290 00000100:00100000:3.0:1788846017.906019:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:1.0:1788846017.906025:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683474176:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846017.906044:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683474432:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846017.906105:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683473920 00000100:00100000:2.0:1788846017.906124:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683473920 00000100:00080000:0.0:1788846017.906134:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788846017.906141:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846017.906162:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 384 00000100:00100000:2.0:1788846017.906171:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683473920:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846017.906203:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683474176:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 183us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846017.906211:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 290 00000100:00100000:3.0:1788846017.909766:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2399:x1875740683474432:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 3726us (4008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846017.909779:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:3.0:1788846017.913003:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846017.913069:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846017.913110:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846017.913113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683474688 00000100:00100000:0.0:1788846017.913128:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683474688 00000100:00100000:3.0:1788846017.913151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846017.913193:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683474048 00000100:00100000:3.0:1788846017.913202:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683474048 00000100:00100000:0.0:1788846017.913223:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683474560 00000100:00100000:0.0:1788846017.913231:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683474560 00000100:00100000:0.0:1788846017.913266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 291 00000100:00100000:0.0:1788846017.913284:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683474688:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846017.913375:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683474688:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 100us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846017.913986:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 292 00000100:00100000:3.0:1788846017.914007:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:2399:x1875740683474048:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846017.914077:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 291 00000100:00100000:0.0:1788846017.914108:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00100000:0.0:1788846017.914122:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2399:x1875740683474560:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846017.914174:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:2399:x1875740683474048:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 173us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846017.914182:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2399:x1875740683474560:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 59us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846017.914193:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 292 00000100:00100000:0.0:1788846017.914231:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 293 00000100:00080000:3.0:1788846017.914279:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846017.914286:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846017.914401:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683474304 00000100:00100000:3.0:1788846017.914409:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683474304 00000100:00100000:3.0:1788846017.914666:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:3.0:1788846017.914676:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683474304:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846017.914721:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2399:x1875740683474304:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 46us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846017.914729:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:2.0:1788846017.915304:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b595850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683473920:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 9126us (9652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846017.915316:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 384 00000100:00080000:0.0:1788846017.917451:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788846018.362724:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846018.362802:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702414720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846018.362881:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846018.363026:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702414720 00000100:00100000:2.0:1788846018.363034:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702414720 00000100:00100000:2.0:1788846018.363092:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788846018.363101:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702414720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846018.363132:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788846018.363183:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702414720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846018.363190:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788846018.363280:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702414720:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1788846018.877905:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:3.0:1788846018.877919:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788846018.878185:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788846018.878198:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788846019.387120:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788846019.734550:0:14504:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:40:18 (1788846018) 00010000:00010000:2.0:1788846020.409813:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846020.922111:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702414848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846020.922230:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846020.922764:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702414976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788846020.922815:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846020.922903:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702414848 00000100:00100000:1.0:1788846020.922911:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702414848 00000100:00100000:1.0:1788846020.922980:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702414976 00000100:00100000:1.0:1788846020.922984:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702414976 00000100:00100000:1.0:1788846020.923005:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788846020.923022:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702414848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788846020.923059:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846020.923125:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702414848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846020.923132:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788846020.923149:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788846020.923156:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702414976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788846020.923165:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788846020.923194:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702414976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846020.923199:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788846020.923243:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702414976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846020.923356:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702414848:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788846020.923425:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846020.939073:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846020.939369:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683474944 00000100:00100000:3.0:1788846020.939379:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683474944 00000100:00100000:3.0:1788846020.939463:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:3.0:1788846020.939474:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:12141:x1875740683474944:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846020.939494:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846020.939514:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d5613827233b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546f7 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939613:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939627:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939639:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939684:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939692:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939698:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939788:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272350 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939798:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272350 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939805:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272350 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846020.939814:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788846020.939916:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939925:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939931:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939938:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846020.939942:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939960:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939972:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e458422600) 00010000:00010000:3.0:1788846020.939975:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846020.939979:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939985:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d56138272342 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.939998:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.940003:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.940009:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.940014:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846020.940017:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.940024:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.940030:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90e461481b00) 00010000:00010000:3.0:1788846020.940033:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846020.940035:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.940060:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272349 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.940978:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d5613827233b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f7 expref: 16 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.940999:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272350 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f7 expref: 15 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846020.941006:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:3.0:1788846020.941009:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846020.941011:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065e00, rc 0) 00000100:00100000:3.0:1788846020.941095:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:12141:x1875740683474944:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1622us (2030us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788846020.941103:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00080000:0.0:1788846020.941246:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846020.953285:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846020.953362:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683475072 00000100:00100000:0.0:1788846020.953373:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683475072 00000100:00100000:0.0:1788846020.953444:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:0.0:1788846020.953454:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:12141:x1875740683475072:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788846020.953586:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:12141:x1875740683475072:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 134us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846020.953594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 151 00000100:00100000:1.0:1788846020.959237:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846020.960590:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683475200 00000100:00100000:0.0:1788846020.960602:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683475200 00000100:00100000:0.0:1788846020.960679:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1788846020.960690:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:2399:x1875740683475200:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846020.960705:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846020.960728:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272350 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f7 expref: 15 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846020.960749:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:0.0:1788846020.960753:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846020.960800:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:2399:x1875740683475200:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 112us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846020.960807:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1788846020.964336:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846020.964415:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683475328 00000100:00100000:0.0:1788846020.964424:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683475328 00000100:00100000:0.0:1788846020.964493:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00100000:0.0:1788846020.964503:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:12141:x1875740683475328:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788846020.964636:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:12141:x1875740683475328:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 133us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846020.964658:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 152 00000100:00080000:3.0:1788846020.964884:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1788846021.369674:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788846021.369684:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788846021.371405:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788846021.371421:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788846021.434792:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702415360:0@lo:400:kworker.0 00000100:00100000:2.0:1788846021.434892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846021.434944:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702415872:0@lo:400:kworker.0 00000100:00100000:2.0:1788846021.434971:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846021.434992:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702416384:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.435247:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702415104:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.435282:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846021.435307:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702415616:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.435331:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846021.435350:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702416128:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.435373:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846021.435389:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702416640:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.435409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846021.435460:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788846021.435467:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e450f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702415232:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.435490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846021.435518:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702415744:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.435556:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846021.435749:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702415488:0@lo:400:kworker.0 00000100:00100000:1.0:1788846021.435790:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702415360 00000100:00100000:3.0:1788846021.435791:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702415872 00000100:00100000:3.0:1788846021.435798:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702415872 00000100:00100000:1.0:1788846021.435798:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702415360 00000100:00100000:1.0:1788846021.435844:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702415616 00000100:00100000:3.0:1788846021.435861:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702415232 00000100:00100000:3.0:1788846021.435864:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702415232 00000100:00100000:3.0:1788846021.435889:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788846021.435952:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788846021.435972:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702415232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846021.436031:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702415872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846021.436178:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702415616 00000100:00100000:1.0:1788846021.436200:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788846021.436206:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702415360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846021.436279:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702415872:12345-0@lo:400:kworker.0 Request processed in 382us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846021.436287:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788846021.436301:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702415744 00000100:00100000:3.0:1788846021.436303:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702415744 00000100:00100000:3.0:1788846021.436325:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788846021.436330:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702415744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846021.436356:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702415744:12345-0@lo:400:kworker.0 Request processed in 27us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846021.436362:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:3.0:1788846021.436377:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846021.436380:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846021.437227:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702415744:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.437240:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702416256:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.437280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846021.437344:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702415104 00000100:00100000:0.0:1788846021.437350:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702415104 00000100:00100000:0.0:1788846021.437389:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788846021.437397:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702415104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.437440:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702415104:12345-0@lo:400:kworker.0 Request processed in 44us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846021.437459:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788846021.437496:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788846021.437504:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702415616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846021.437733:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702416256 00000100:00100000:3.0:1788846021.437738:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702416256 00000100:00100000:3.0:1788846021.437769:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788846021.437776:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702416256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846021.438418:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702415360:12345-0@lo:400:kworker.0 Request processed in 2210us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846021.438436:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788846021.438666:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702415616:12345-0@lo:400:kworker.0 Request processed in 1162us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846021.438675:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788846021.438697:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846021.438703:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702416128 00000100:00100000:0.0:1788846021.438709:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702416128 00000100:00100000:0.0:1788846021.438740:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702416640 00000100:00100000:0.0:1788846021.438744:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702416640 00000100:00100000:0.0:1788846021.438775:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788846021.438789:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702416000:0@lo:400:kworker.0 00000100:00100000:1.0:1788846021.438819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846021.438830:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702416512:0@lo:400:kworker.0 00000100:00100000:1.0:1788846021.438861:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846021.438890:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702416768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846021.438921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846021.438958:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702416256:12345-0@lo:400:kworker.0 Request processed in 1181us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846021.438967:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788846021.438985:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702415488 00000100:00100000:3.0:1788846021.438989:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702415488 00000100:00100000:3.0:1788846021.439003:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788846021.439008:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702415488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846021.439062:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702415488:12345-0@lo:400:kworker.0 Request processed in 52us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846021.439069:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00010000:00010000:1.0:1788846021.439075:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846021.439092:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788846021.439092:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702416768 00000100:00100000:1.0:1788846021.439098:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702416768 00000100:00080000:3.0:1788846021.439100:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846021.439130:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788846021.439139:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702416768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846021.439163:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788846021.439285:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702416128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846021.439670:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702416768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 530us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846021.439678:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788846021.439683:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702416128:12345-0@lo:400:kworker.0 Request processed in 897us (4306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846021.439693:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788846021.439711:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702416000 00000100:00100000:0.0:1788846021.439715:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702416000 00000100:00100000:0.0:1788846021.439729:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702416512 00000100:00100000:0.0:1788846021.439731:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702416512 00000100:00100000:0.0:1788846021.439756:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788846021.439762:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702416640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846021.439789:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702415488:0@lo:400:kworker.0 00000100:00100000:1.0:1788846021.439823:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702416768:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788846021.439918:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846021.439938:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702415232:12345-0@lo:400:kworker.0 Request processed in 3965us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846021.439947:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788846021.439976:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846021.440028:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702416640:12345-0@lo:400:kworker.0 Request processed in 265us (4616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846021.440044:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788846021.440063:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788846021.440070:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702416000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846021.440095:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702415360:0@lo:400:kworker.0 00010000:00080000:2.0:1788846021.440116:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343b2ca80 x1875740702415872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846021.440126:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702415872:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440141:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702416000:12345-0@lo:400:kworker.0 Request processed in 69us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846021.440200:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702416384 00000100:00100000:3.0:1788846021.440204:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702416384 00000100:00100000:3.0:1788846021.440318:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788846021.440325:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702416384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846021.440372:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702416384:12345-0@lo:400:kworker.0 Request processed in 48us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846021.440380:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1788846021.440434:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788846021.440455:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343b2c380 x1875740702416384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846021.440466:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702416384:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440637:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788846021.440652:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702416000:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440657:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788846021.440668:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702416512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440717:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702416512:12345-0@lo:400:kworker.0 Request processed in 51us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846021.440724:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788846021.440758:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702415232:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440773:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702416256:0@lo:400:kworker.0 00000100:00100000:3.0:1788846021.440829:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702416512:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440935:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e450f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702415104:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440952:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702415616:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440964:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702416128:0@lo:400:kworker.0 00000100:00100000:0.0:1788846021.440976:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702416640:0@lo:400:kworker.0 00000040:00080000:1.0:1788846021.756130:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788846021.946727:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846021.946749:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702416896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788846021.946814:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846021.949678:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846021.949701:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34447b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702417024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788846021.952597:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846021.952772:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702416896 00000100:00100000:3.0:1788846021.952783:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702416896 00000100:00100000:3.0:1788846021.952970:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702417024 00000100:00100000:3.0:1788846021.952974:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702417024 00000100:00100000:3.0:1788846021.952992:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788846021.953001:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702416896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846021.953042:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788846021.953110:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702416896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (6296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846021.953117:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788846021.953133:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788846021.953139:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702417024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788846021.953149:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788846021.953173:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702417024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846021.953179:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788846021.953226:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702416896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846021.953363:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34447b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702417024:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788846022.458155:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846022.819166:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846022.819294:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683475456 00000100:00100000:2.0:1788846022.819304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683475456 00000100:00100000:2.0:1788846022.819367:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:2.0:1788846022.819377:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:12183:x1875740683475456:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846022.819396:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846022.819424:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d5613827235e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217546fe expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819492:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819507:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819539:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819555:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819563:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819569:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819934:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819943:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819949:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819955:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846022.819959:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819977:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.819989:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:2.0:1788846022.819992:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846022.819996:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820002:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d56138272365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820015:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820021:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820036:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820041:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846022.820044:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820049:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820056:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90e3424a3a00) 00010000:00010000:2.0:1788846022.820059:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846022.820062:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820078:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827236c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820114:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d5613827235e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546fe expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820124:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:2.0:1788846022.820126:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846022.820614:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d5613827235e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546fe expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.820630:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030c00, rc 0) 00000100:00100000:2.0:1788846022.820692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:12183:x1875740683475456:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1316us (1535us total) trans 0 rc 301/301 00000100:00100000:2.0:1788846022.820700:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00080000:2.0:1788846022.820727:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846022.830511:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846022.830557:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683475712 00000100:00100000:3.0:1788846022.830572:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683475712 00000100:00100000:3.0:1788846022.830674:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:3.0:1788846022.830686:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:12183:x1875740683475712:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:3.0:1788846022.830753:0:12145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846022.830780:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138271cb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754522 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.831912:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:3.0:1788846022.831918:0:12145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846022.831987:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.832004:0:12145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.832012:0:12145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.832059:0:12145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.832074:0:12145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 5 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846022.832087:0:12145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702417152:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846022.832182:0:12145:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846022.838151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846022.838210:0:12145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702417152:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846022.838238:0:12145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846022.838307:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683475840 00000100:00100000:3.0:1788846022.838314:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683475840 00010000:00010000:3.0:1788846022.838367:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 6 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846022.838405:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:3.0:1788846022.838415:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2399:x1875740683475840:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846022.838430:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846022.838437:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 6 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.838448:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 6 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.838470:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272334 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546f0 expref: 6 pid: 6515 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.838484:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:3.0:1788846022.838489:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.838497:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.838503:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846022.838542:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846022.838586:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2399:x1875740683475840:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 172us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846022.838594:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00080000:0.0:1788846022.838858:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788846022.838873:0:12145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.838886:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.838909:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.838918:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.838926:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.839671:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.839683:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.839702:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846022.839719:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000024b59bf reply state 0000000094b6d611 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.839730:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.839737:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846022.839740:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846022.839743:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788846022.839749:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788846022.839764:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.839771:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.839778:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.841099:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846022.841108:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.841119:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.841133:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3437a7e00) 00010000:00010000:0.0:1788846022.841136:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846022.841140:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.841146:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272373 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846022.841165:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000024b59bf reply state 0000000094b6d611 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.841174:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846022.841180:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90e4514bd800) 00010000:00010000:0.0:1788846022.841183:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846022.841192:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788846022.841275:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:12183:x1875740683475712:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 10588us (10770us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788846022.841284:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 154 00000100:00100000:0.0:1788846022.961081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846022.962476:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683475968 00000100:00100000:2.0:1788846022.962488:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683475968 00000100:00100000:2.0:1788846022.962589:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:2.0:1788846022.962601:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+15:12191:x1875740683475968:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:2.0:1788846022.962626:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846022.962647:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754705 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.962980:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827238f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.963011:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827238f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.963023:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827238f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846022.963078:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788846022.963081:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846022.963101:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827238f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.963124:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754705 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.963143:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827238f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754705 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846022.963152:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:2.0:1788846022.963155:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846022.963158:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031e00, rc 0) 00000100:00100000:2.0:1788846022.963213:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:12191:x1875740683475968:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 614us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846022.967214:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 155 00000100:00100000:0.0:1788846023.026046:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.026086:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.026121:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.026151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.026175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.026204:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683476352 00000100:00100000:0.0:1788846023.026212:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683476352 00000100:00100000:0.0:1788846023.026275:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683476480 00000100:00100000:0.0:1788846023.026278:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683476480 00000100:00100000:0.0:1788846023.026442:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:0.0:1788846023.026454:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683476352:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846023.026549:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683476352:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 66us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846023.026558:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:0.0:1788846023.026575:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:0.0:1788846023.026582:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683476480:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846023.026608:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683476480:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846023.026614:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00080000:0.0:1788846023.026630:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788846023.026634:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846023.026769:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683476096 00000100:00100000:2.0:1788846023.026774:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683476096 00000100:00100000:2.0:1788846023.026806:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 386 00000100:00100000:2.0:1788846023.026813:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683476096:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846023.026841:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b594c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683476096:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 29us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.026861:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 386 00000100:00100000:2.0:1788846023.026906:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683476608 00000100:00100000:2.0:1788846023.026911:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683476608 00000100:00100000:2.0:1788846023.026942:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683476224 00000100:00100000:2.0:1788846023.026945:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683476224 00000100:00100000:2.0:1788846023.026966:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 300 00000100:00100000:2.0:1788846023.026973:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683476608:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846023.027000:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683476608:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 28us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.027006:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 300 00000100:00100000:2.0:1788846023.027018:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00100000:2.0:1788846023.027034:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683476224:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846023.027057:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683476224:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 34us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.027063:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 301 00000100:00080000:2.0:1788846023.027081:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846023.038291:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.038413:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683476736 00000100:00100000:2.0:1788846023.038423:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683476736 00000100:00100000:2.0:1788846023.038485:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:2.0:1788846023.038497:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+16:12197:x1875740683476736:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846023.038567:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846023.038588:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272396 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175470c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038655:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038678:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038691:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038704:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038711:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038718:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038796:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382723ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038806:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382723ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038813:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382723ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846023.038846:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788846023.038850:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846023.038870:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382723ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038880:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038896:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038902:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038907:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846023.038912:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038919:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038930:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:2.0:1788846023.038934:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846023.038939:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038944:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827239d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038958:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038964:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038970:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038975:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846023.038985:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.038991:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.039014:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90e4514bd800) 00010000:00010000:2.0:1788846023.039017:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846023.039020:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.039035:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.039066:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d56138272396 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175470c expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.039080:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382723ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175470c expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.039087:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:2.0:1788846023.039089:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788846023.039091:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031a00, rc 0) 00000100:00100000:2.0:1788846023.039158:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:12197:x1875740683476736:12345-192.168.203.20@tcp:101:bash.0 Request processed in 663us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.039165:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 156 00000100:00100000:2.0:1788846023.043071:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846023.043187:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683476992 00000100:00100000:1.0:1788846023.043196:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683476992 00000100:00100000:1.0:1788846023.043252:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:1.0:1788846023.043262:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+17:12197:x1875740683476992:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1788846023.043299:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846023.043319:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382723b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754713 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.043414:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.043428:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.043439:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.043462:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.043469:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.043475:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788846023.043823:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788846023.043968:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.043978:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.043985:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044757:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044764:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044770:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044777:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846023.044781:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044787:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044800:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:1.0:1788846023.044803:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846023.044807:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044812:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788846023.044826:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072462799 reply state 000000002501fa10 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044836:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.044945:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:1.0:1788846023.044955:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788846023.044959:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788846023.045066:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382723b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.045083:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.045090:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235b00) 00010000:00010000:1.0:1788846023.045092:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846023.045094:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3200, rc 0) 00000100:00100000:1.0:1788846023.045201:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:12197:x1875740683476992:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1941us (2139us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788846023.045209:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 157 00000100:00100000:3.0:1788846023.054639:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.054887:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683477120 00000100:00100000:0.0:1788846023.054896:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683477120 00000100:00100000:0.0:1788846023.054956:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1788846023.054966:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683477120:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846023.054984:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846023.055015:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175471a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788846023.055051:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846023.055072:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1788846023.055077:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846023.055086:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.055105:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.055119:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356400, rc 0) 00000100:00100000:0.0:1788846023.055179:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683477120:12345-192.168.203.20@tcp:101:bash.0 Request processed in 215us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846023.055186:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1788846023.060041:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.060200:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683477248 00000100:00100000:2.0:1788846023.060210:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683477248 00000100:00100000:2.0:1788846023.060297:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1788846023.060323:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:12197:x1875740683477248:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846023.060339:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846023.060357:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754721 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.060388:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.060397:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846023.060402:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846023.060407:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.060440:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.060454:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 7 pid: 8430 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846023.060477:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34447a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875740702417280:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846023.060608:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846023.062912:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34447a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875740702417280:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846023.062947:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 7 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.062986:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030c00, rc 0) 00000100:00100000:2.0:1788846023.063052:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:12197:x1875740683477248:12345-192.168.203.20@tcp:101:bash.0 Request processed in 2731us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.063059:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1788846023.063941:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846023.064110:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683477376 00000100:00100000:1.0:1788846023.064128:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683477376 00010000:00010000:1.0:1788846023.064162:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 7 pid: 8430 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846023.064197:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:1.0:1788846023.064204:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683477376:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846023.064214:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846023.064230:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 7 pid: 8430 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.064239:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 7 pid: 8430 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.064272:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e747a2e2/0x21b4d561382723d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175471a expref: 7 pid: 8430 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.064287:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846023.064291:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846023.064299:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 6 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.064308:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 6 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.064342:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 6 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846023.064353:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3444ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6502:1875740702417408:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846023.064413:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846023.070774:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846023.071075:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683477632 00000100:00100000:1.0:1788846023.071079:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3444ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6502:1875740702417408:192.168.203.20@tcp:105: 00000100:00100000:3.0:1788846023.071083:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683477632 00010000:00010000:1.0:1788846023.071106:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846023.071146:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:3.0:1788846023.071156:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:12197:x1875740683477632:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1788846023.071448:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:12197:x1875740683477632:12345-192.168.203.20@tcp:35:bash.0 Request processed in 293us (683us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788846023.071457:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:1.0:1788846023.072639:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2398:x1875740683477376:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 8426us (8694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846023.072651:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:2.0:1788846023.146183:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846023.147695:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683477888 00000100:00100000:1.0:1788846023.147709:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683477888 00000100:00100000:1.0:1788846023.147785:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 158 00000100:00100000:1.0:1788846023.147808:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:12207:x1875740683477888:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846023.147832:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846023.147851:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754728 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846023.147945:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788846023.148185:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754728 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.148198:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:1.0:1788846023.148201:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846023.148205:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754728 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.148219:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3400, rc 0) 00000100:00100000:1.0:1788846023.148291:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:12207:x1875740683477888:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 484us (2118us total) trans 4294967422 rc 301/301 00000100:00100000:1.0:1788846023.148298:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 158 00000100:00100000:2.0:1788846023.158504:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846023.158615:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683478144 00000100:00100000:3.0:1788846023.158625:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683478144 00000100:00100000:3.0:1788846023.158684:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:3.0:1788846023.158695:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:12207:x1875740683478144:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1788846023.158903:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:12207:x1875740683478144:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 210us (410us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788846023.158911:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:0.0:1788846023.269626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.269723:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683478272 00000100:00100000:2.0:1788846023.269733:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683478272 00000100:00100000:2.0:1788846023.269796:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:2.0:1788846023.269806:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:12213:x1875740683478272:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846023.269828:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846023.269859:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382723f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175472f expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.269923:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.269937:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.269948:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846023.269991:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788846023.269995:0:7876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846023.270015:0:7876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.270072:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d561382723f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175472f expref: 25 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.270093:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175472f expref: 24 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.270101:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:2.0:1788846023.270105:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846023.270108:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031c00, rc 0) 00000100:00100000:2.0:1788846023.270173:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:12213:x1875740683478272:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 368us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.270181:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 159 00000100:00100000:2.0:1788846023.279420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846023.279959:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683478528 00000100:00100000:1.0:1788846023.279969:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683478528 00000100:00100000:1.0:1788846023.280143:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:1.0:1788846023.280155:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:12213:x1875740683478528:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846023.280175:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846023.280196:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754736 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.280298:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138272406 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.280324:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138272406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.280336:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138272406 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846023.280348:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788846023.280465:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d561382723ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754736 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.280484:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138272406 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754736 expref: 26 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.280493:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235b00) 00010000:00010000:1.0:1788846023.280496:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846023.280499:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3000, rc 0) 00000100:00100000:1.0:1788846023.280606:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+26:12213:x1875740683478528:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 453us (1196us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788846023.280613:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 160 00000100:00100000:2.0:1788846023.287276:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846023.288143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683478784 00000100:00100000:1.0:1788846023.288154:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683478784 00000100:00100000:1.0:1788846023.288215:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:1.0:1788846023.288226:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+26:12213:x1875740683478784:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846023.288249:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846023.288268:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138272414 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175473d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.288397:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d5613827241b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.288412:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d5613827241b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.288423:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d5613827241b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846023.288434:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788846023.288555:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138272414 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175473d expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.288573:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d5613827241b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175473d expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.288580:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235b00) 00010000:00010000:1.0:1788846023.288583:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788846023.288587:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3a00, rc 0) 00000100:00100000:1.0:1788846023.290163:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+28:12213:x1875740683478784:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1928us (2886us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1788846023.290174:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 161 00000100:00100000:0.0:1788846023.291933:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.292197:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683478912 00000100:00100000:2.0:1788846023.292206:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683478912 00000100:00100000:2.0:1788846023.292266:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:2.0:1788846023.292276:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+28:2398:x1875740683478912:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846023.292290:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846023.292313:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3000/0x21b4d56138272406 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754736 expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.292333:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235b00) 00010000:00010000:2.0:1788846023.292338:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846023.292401:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:2398:x1875740683478912:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 126us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.292425:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1788846023.299140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.299221:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683479040 00000100:00100000:0.0:1788846023.299247:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683479040 00000100:00100000:0.0:1788846023.299365:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:0.0:1788846023.299376:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683479040:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:0.0:1788846023.299422:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.299443:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 6 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.299451:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846023.299456:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846023.299461:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.299497:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 6 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.299512:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 6 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846023.299557:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f536300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875740702417536:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846023.299691:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685000 going to sleep for 11 seconds 00000100:00100000:2.0:1788846023.306123:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f536300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875740702417536:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846023.306154:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846023.308645:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.309201:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683479168 00000100:00100000:2.0:1788846023.309212:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683479168 00002000:00100000:2.0:1788846023.309262:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90e3444ed180 x1875740683479168/t0(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:374/0 lens 504/0 e 0 to 0 dl 1788846034 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788846023.309274:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e3444ed180 with x1875740683479168 ext(0->12) 00010000:00010000:2.0:1788846023.309284:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 7 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.309302:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 7 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846023.309309:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e3444ed180 00000100:00100000:2.0:1788846023.309332:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1788846023.309342:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683479168:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:2.0:1788846023.310431:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683479168:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 1084us (1789us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788846023.310441:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00002000:00100000:2.0:1788846023.310603:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff90e3444ed180 x1875740683479168/t4294967306(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:374/0 lens 504/448 e 0 to 0 dl 1788846034 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788846023.310628:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e3444ed180 with x1875740683479168 ext(0->12) 00010000:00010000:2.0:1788846023.310636:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 9 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.310649:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 9 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846023.310657:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e3444ed180 00000100:00100000:0.0:1788846023.314193:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846023.314442:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683479296 00000100:00100000:1.0:1788846023.314453:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683479296 00010000:00010000:1.0:1788846023.314492:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 9 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846023.314561:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 82 00000100:00100000:1.0:1788846023.314585:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2400:x1875740683479296:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846023.314600:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788846023.314619:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788846023.314622:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788846023 00002000:00010000:1.0:1788846023.314625:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788846023 00002000:00010000:1.0:1788846023.314627:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788846023 00002000:00010000:1.0:1788846023.314629:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788846023.314635:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 9 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.314650:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 9 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.314675:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008005b0fb/0x21b4d561382723dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754721 expref: 9 pid: 8906 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.314695:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846023.314700:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846023.314705:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.314714:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846023.314740:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846023.314795:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2400:x1875740683479296:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 213us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846023.314811:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 82 00010000:00010000:0.0:1788846023.315556:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.315569:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.315601:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.315608:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.315616:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.315623:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846023.315627:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.315635:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.315649:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.315656:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1ba1e50/0x21b4d56138272429 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846023.315724:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2401:x1875740683479040:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 16349us (16592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846023.315733:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:0.0:1788846023.318720:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846023.319118:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683479552 00000100:00100000:3.0:1788846023.319129:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683479552 00000100:00100000:3.0:1788846023.319256:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:3.0:1788846023.319268:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:12213:x1875740683479552:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:3.0:1788846023.319407:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d5613827241b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175473d expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788846023.320282:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788846023.320476:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1788846023.321377:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:3.0:1788846023.321442:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846023.321646:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846023.321658:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846023.321697:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846023.321711:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 31 pid: 6515 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846023.321726:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875740702417664:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846023.321874:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846023.327925:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.327987:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683479680 00000100:00100000:2.0:1788846023.328006:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683479680 00010000:00010000:2.0:1788846023.328064:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 32 pid: 6515 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846023.328105:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 83 00000100:00100000:2.0:1788846023.328115:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:2399:x1875740683479680:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846023.328130:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846023.328137:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 32 pid: 6515 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.328150:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 32 pid: 6515 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.328172:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235b00) 00010000:00010000:2.0:1788846023.328177:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.328204:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.328211:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846023.328224:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382723c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754713 expref: 32 pid: 6515 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.328229:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846023.328240:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875740702417664:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846023.328259:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846023.328312:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+31:2399:x1875740683479680:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 168us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.328321:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 83 00010000:00010000:2.0:1788846023.328344:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.328354:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846023.328472:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1788846023.328617:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788846023.328705:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344478700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702417792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788846023.328752:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846023.328783:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846023.328903:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702417792 00000100:00100000:3.0:1788846023.328908:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702417792 00000100:00100000:3.0:1788846023.328966:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788846023.328973:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875740702417792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788846023.329192:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875740702417792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 219us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846023.329209:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1788846023.329641:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846023.330138:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344478700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702417792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788846023.330269:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:0.0:1788846023.330392:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f537480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702417920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788846023.330436:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846023.330647:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702417920 00000100:00100000:2.0:1788846023.330654:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702417920 00000100:00100000:2.0:1788846023.330748:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788846023.330758:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875740702417920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788846023.331041:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875740702417920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 284us (603us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788846023.331061:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788846023.331197:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341082240 going to sleep for 11 seconds 00000100:00100000:0.0:1788846023.331220:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f537480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702417920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788846023.331261:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788846023.331362:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.331371:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.331378:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.331385:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846023.331389:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.331396:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.331410:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235b00) 00010000:00010000:0.0:1788846023.331413:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788846023.331417:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.331423:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272430 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788846023.331879:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788846023.331941:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788846023.331952:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407369430888ns, next at 408369428743ns, rc = 0 00000001:00080000:0.0:1788846023.331959:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:0.0:1788846023.331982:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235b00) 00010000:00010000:0.0:1788846023.331986:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788846023.332106:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3a00/0x21b4d5613827241b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175473d expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846023.332390:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+34:12213:x1875740683479552:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 13123us (13676us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788846023.332399:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000020:00080000:0.0:1788846023.332403:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788846023.335970:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.336035:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683479808 00000100:00100000:0.0:1788846023.336045:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683479808 00000100:00100000:0.0:1788846023.336106:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:0.0:1788846023.336116:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+34:12213:x1875740683479808:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846023.336139:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846023.336158:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272437 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754744 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.336212:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272437 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754744 expref: 35 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.336226:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272437 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754744 expref: 35 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.336264:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846023.336267:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846023.336270:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357600, rc 0) 00000100:00100000:0.0:1788846023.336499:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:12213:x1875740683479808:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 383us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846023.336626:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 162 00000100:00100000:2.0:1788846023.343659:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.343810:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683480064 00000100:00100000:0.0:1788846023.343819:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683480064 00000100:00100000:0.0:1788846023.343877:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:0.0:1788846023.343886:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:12213:x1875740683480064:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1788846023.344101:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+36:12213:x1875740683480064:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 215us (450us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788846023.344109:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:1.0:1788846023.458835:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.458947:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683480320 00000100:00100000:2.0:1788846023.458957:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683480320 00000100:00100000:2.0:1788846023.459038:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:2.0:1788846023.459050:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+36:12223:x1875740683480320:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846023.459074:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846023.459094:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d5613827243e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175474b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846023.459186:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788846023.459279:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d5613827243e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175474b expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.459293:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:2.0:1788846023.459297:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846023.459302:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d5613827243e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175474b expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.459318:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030c00, rc 0) 00000100:00100000:2.0:1788846023.459439:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:12223:x1875740683480320:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 392us (613us total) trans 4294967436 rc 301/301 00000100:00100000:2.0:1788846023.459446:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 163 00000100:00100000:1.0:1788846023.464231:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.464343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683480448 00000100:00100000:2.0:1788846023.464353:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683480448 00000100:00100000:2.0:1788846023.464499:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:2.0:1788846023.464510:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:12223:x1875740683480448:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1788846023.464782:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.464798:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.464809:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.464820:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.464827:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.464852:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.464921:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.464930:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.464936:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846023.464980:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465002:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465039:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465047:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465054:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846023.465058:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465067:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465080:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:2.0:1788846023.465083:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846023.465087:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465093:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030200/0x21b4d5613827244c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465111:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465117:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465122:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465126:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846023.465135:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465142:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465149:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:2.0:1788846023.465152:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846023.465154:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465159:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272453 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465169:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465174:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465178:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465183:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846023.465186:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465191:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465198:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846023.465200:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846023.465211:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.465217:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827245a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846023.465755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:12223:x1875740683480448:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 1243us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.465763:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 164 00000100:00100000:3.0:1788846023.473622:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.473712:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683480704 00000100:00100000:0.0:1788846023.473722:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683480704 00000100:00100000:0.0:1788846023.473774:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1788846023.473784:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:12223:x1875740683480704:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1788846023.473997:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:12223:x1875740683480704:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 215us (383us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788846023.474005:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1788846023.481930:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702418048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846023.482000:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846023.482144:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702418048 00000100:00100000:1.0:1788846023.482152:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702418048 00000100:00100000:1.0:1788846023.482203:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788846023.482212:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702418048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846023.482243:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788846023.482309:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702418048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846023.482316:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788846023.482356:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4412aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702418048:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788846023.482779:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846023.511288:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.511383:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683480960 00000100:00100000:0.0:1788846023.511394:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683480960 00000100:00100000:0.0:1788846023.511586:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:0.0:1788846023.511600:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:12226:x1875740683480960:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846023.511623:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846023.511642:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272461 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754752 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511712:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511727:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511739:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511749:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511756:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511763:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511863:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511873:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511880:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846023.511902:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788846023.511979:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511987:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.511993:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512000:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846023.512005:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512012:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512039:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846023.512043:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846023.512047:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512054:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272468 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512076:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512082:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512097:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512102:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846023.512105:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512110:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512118:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:0.0:1788846023.512120:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846023.512123:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512129:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827246f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512171:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272461 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 41 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512185:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 40 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.512192:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846023.512193:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846023.512196:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357a00, rc 0) 00000100:00100000:0.0:1788846023.512262:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+40:12226:x1875740683480960:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 667us (983us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788846023.512278:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:1.0:1788846023.516833:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.516986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683481088 00000100:00100000:2.0:1788846023.517004:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683481088 00000100:00100000:2.0:1788846023.517069:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:2.0:1788846023.517080:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+40:12226:x1875740683481088:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1788846023.517169:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517187:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517198:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517231:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517238:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517245:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517251:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846023.517263:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517272:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517284:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846023.517287:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846023.517291:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.517297:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272484 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846023.517405:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4412aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+40:12226:x1875740683481088:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 327us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.517413:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 166 00000100:00100000:3.0:1788846023.523078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.523221:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683481344 00000100:00100000:0.0:1788846023.523233:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683481344 00000100:00100000:0.0:1788846023.523294:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:0.0:1788846023.523304:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+40:12226:x1875740683481344:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1788846023.523594:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+41:12226:x1875740683481344:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 290us (524us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788846023.523604:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1788846023.792194:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.792298:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683481600 00000100:00100000:2.0:1788846023.792309:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683481600 00000100:00100000:2.0:1788846023.792380:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:2.0:1788846023.792390:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+41:12257:x1875740683481600:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1788846023.792416:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846023.792436:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827248b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754759 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.792579:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272492 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.792594:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.793005:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272492 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846023.793028:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788846023.793156:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d5613827248b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754759 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.793175:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272492 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754759 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.793184:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846023.793187:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846023.793190:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c800, rc 0) 00000100:00100000:2.0:1788846023.793262:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:12257:x1875740683481600:12345-192.168.203.20@tcp:101:cat.0 Request processed in 874us (1079us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788846023.793270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:0.0:1788846023.798277:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.798320:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846023.798405:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683481984 00000100:00100000:3.0:1788846023.798415:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683481984 00000100:00100000:3.0:1788846023.798473:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:3.0:1788846023.798484:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:12257:x1875740683481984:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:2.0:1788846023.799175:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683481728 00000100:00100000:2.0:1788846023.799182:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683481728 00000100:00100000:3.0:1788846023.799291:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+45:12257:x1875740683481984:12345-192.168.203.20@tcp:35:cat.0 Request processed in 807us (967us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788846023.799300:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1788846023.799952:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1788846023.799964:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+44:2401:x1875740683481728:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846023.799979:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846023.800003:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272492 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754759 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.800032:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846023.800037:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846023.800102:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:2401:x1875740683481728:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 140us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.800109:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1788846023.880773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.882546:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683482240 00000100:00100000:2.0:1788846023.882559:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683482240 00000100:00100000:2.0:1788846023.882682:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 168 00000100:00100000:2.0:1788846023.882694:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:12263:x1875740683482240:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:2.0:1788846023.882717:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846023.882720:0:12145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788846023.882746:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382723f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175472f expref: 43 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.882767:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:2.0:1788846023.882772:0:12145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846023.882784:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382724a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754760 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.882883:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.882898:0:12145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 43 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.882906:0:12145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.882936:0:12145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 43 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.882967:0:12145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 43 pid: 12145 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846023.882982:0:12145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34447bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702418176:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846023.883108:0:12145:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846023.887825:0:12145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34447bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702418176:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846023.887858:0:12145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846023.895567:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846023.896313:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683482368 00000100:00100000:0.0:1788846023.896325:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683482368 00010000:00010000:0.0:1788846023.896366:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 44 pid: 12145 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846023.896467:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 84 00000100:00100000:0.0:1788846023.896478:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+44:2399:x1875740683482368:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846023.896493:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846023.896500:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 44 pid: 12145 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.896553:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 44 pid: 12145 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.896578:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272476 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754752 expref: 44 pid: 12145 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.896611:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846023.896618:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.896627:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.896636:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846023.896671:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846023.896720:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:2399:x1875740683482368:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 244us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846023.896728:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 84 00010000:00010000:3.0:1788846023.896785:0:12145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846023.896793:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846023.896811:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788846023.896954:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382724a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 44 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846023.896972:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 43 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846023.896981:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846023.896984:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788846023.896986:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d600, rc 0) 00000100:00100000:3.0:1788846023.897055:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:12263:x1875740683482240:12345-192.168.203.20@tcp:101:dd.0 Request processed in 14363us (16289us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788846023.897062:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 168 00000100:00100000:3.0:1788846023.899481:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.899688:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683482496 00000100:00100000:2.0:1788846023.899698:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683482496 00000100:00100000:2.0:1788846023.899755:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:2.0:1788846023.899766:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:12263:x1875740683482496:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:2.0:1788846023.899788:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846023.899809:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754767 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.899844:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.899859:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.899872:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.900277:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 45 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.900305:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.900314:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846023.900318:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846023.900322:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d000, rc 0) 00000100:00100000:2.0:1788846023.900417:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+44:12263:x1875740683482496:12345-192.168.203.20@tcp:101:dd.0 Request processed in 653us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846023.900425:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 169 00000100:00100000:1.0:1788846023.906222:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846023.906322:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683482752 00000100:00100000:2.0:1788846023.906338:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683482752 00000100:00100000:2.0:1788846023.906412:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 170 00000100:00100000:2.0:1788846023.906423:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+44:12263:x1875740683482752:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:2.0:1788846023.906679:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.906698:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.906710:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846023.906765:0:7876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788846023.906787:0:7876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055a8a7f6 reply state 00000000c9895e35 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.906800:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846023.906823:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846023.906826:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846023.906829:0:7876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846023.906944:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:12263:x1875740683482752:12345-192.168.203.20@tcp:36:dd.0 Request processed in 521us (737us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788846023.906952:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 170 00000020:00080000:2.0:1788846023.906957:0:7876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788846024.159973:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846024.160179:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683482880 00000100:00100000:3.0:1788846024.160189:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683482880 00000100:00100000:3.0:1788846024.160267:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:3.0:1788846024.160280:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:12277:x1875740683482880:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:3.0:1788846024.160303:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846024.160323:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382724ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175476e expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160391:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160407:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160419:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160430:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160438:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160445:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160560:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160728:0:12145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 48 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160737:0:12145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160819:0:12145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 48 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.160834:0:12145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 48 pid: 12145 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846024.160847:0:12145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702418304:192.168.203.20@tcp:104: 00000100:00080000:2.0:1788846024.160999:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846024.161401:0:12145:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846024.166276:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846024.166499:0:12145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702418304:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846024.166563:0:12145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846024.166779:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683483136 00000100:00100000:0.0:1788846024.166787:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683483136 00000100:00100000:0.0:1788846024.166832:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:0.0:1788846024.166840:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+49:6166:x1875740683483136:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788846024.167212:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+50:6166:x1875740683483136:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 370us (943us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1788846024.167221:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:1.0:1788846024.181229:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846024.181417:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683483264 00000100:00100000:2.0:1788846024.181427:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683483264 00010000:00010000:2.0:1788846024.181465:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 50 pid: 12145 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846024.181512:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 85 00000100:00100000:2.0:1788846024.181555:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+50:2399:x1875740683483264:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846024.181569:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846024.181576:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 50 pid: 12145 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.181590:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 50 pid: 12145 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.181611:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754760 expref: 50 pid: 12145 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.181641:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846024.181646:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.181655:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.181663:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.181702:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846024.181762:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+49:2399:x1875740683483264:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 240us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846024.181770:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 85 00010000:00010000:3.0:1788846024.181849:0:12145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.181858:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846024.181926:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788846024.181931:0:12145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846024.181957:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.181969:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.181991:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.181998:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182024:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182031:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846024.182036:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182044:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182055:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846024.182058:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846024.182066:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182073:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382724d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182085:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182092:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182098:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182110:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846024.182114:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182120:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182130:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:3.0:1788846024.182138:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846024.182141:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182148:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382724d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182184:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382724ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175476e expref: 49 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182200:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175476e expref: 48 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.182207:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846024.182210:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846024.182212:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846024.182243:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+48:12277:x1875740683482880:12345-192.168.203.20@tcp:101:stat.0 Request processed in 21968us (22280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846024.182252:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 171 00000100:00100000:1.0:1788846024.287472:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846024.287583:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683483520 00000100:00100000:2.0:1788846024.287593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683483520 00000100:00100000:2.0:1788846024.287663:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 172 00000100:00100000:2.0:1788846024.287673:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+48:12283:x1875740683483520:12345-192.168.203.20@tcp:36:truncate.0 00010000:00010000:2.0:1788846024.287730:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846024.287757:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382724df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175476e expref: 48 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.287786:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846024.287792:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846024.287950:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.287964:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.287988:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846024.288043:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:2.0:1788846024.288064:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f086003 reply state 0000000079bfb3c4 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.288076:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.288083:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846024.288085:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846024.288088:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846024.288183:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+50:12283:x1875740683483520:12345-192.168.203.20@tcp:36:truncate.0 Request processed in 511us (719us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788846024.288190:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 172 00000020:00080000:2.0:1788846024.288194:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788846024.444447:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788846024.444457:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846024.444581:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788846024.444590:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788846024.475812:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846024.476030:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683483648 00000100:00100000:0.0:1788846024.476040:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683483648 00000100:00100000:0.0:1788846024.476123:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 173 00000100:00100000:0.0:1788846024.476132:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+50:12297:x1875740683483648:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:0.0:1788846024.476154:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846024.476186:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382724ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754775 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476254:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476267:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476278:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476287:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476294:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476304:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476365:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476373:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476380:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846024.476413:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788846024.476417:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846024.476433:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476450:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476457:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476463:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476470:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476480:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846024.476485:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476492:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476504:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846024.476507:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846024.476512:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476538:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382724f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476550:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476556:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476566:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476572:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846024.476575:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476581:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476589:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:0.0:1788846024.476591:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846024.476593:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476599:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382724fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476623:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382724ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 52 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476634:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 51 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.476642:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846024.476644:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846024.476646:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356a00, rc 0) 00000100:00100000:0.0:1788846024.476698:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+51:12297:x1875740683483648:12345-192.168.203.20@tcp:101:stat.0 Request processed in 568us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846024.476713:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 173 00010000:00010000:1.0:1788846024.507633:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846024.581858:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846024.581952:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683483904 00000100:00100000:3.0:1788846024.581976:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683483904 00000100:00100000:3.0:1788846024.582044:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:3.0:1788846024.582053:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+51:12307:x1875740683483904:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846024.582072:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846024.582091:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272509 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175477c expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846024.582194:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788846024.582288:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272509 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175477c expref: 53 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.582303:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:3.0:1788846024.582305:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788846024.582310:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272509 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175477c expref: 53 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.582323:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065800, rc 0) 00000100:00100000:3.0:1788846024.582423:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+52:12307:x1875740683483904:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 370us (573us total) trans 4294967448 rc 301/301 00000100:00100000:3.0:1788846024.582430:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 174 00000100:00100000:2.0:1788846024.592908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846024.593052:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683484160 00000100:00100000:0.0:1788846024.593063:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683484160 00000100:00100000:0.0:1788846024.593120:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1788846024.593130:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+52:12307:x1875740683484160:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1788846024.593367:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+53:12307:x1875740683484160:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 237us (467us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788846024.593375:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1788846024.670132:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846024.670358:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683484416 00000100:00100000:2.0:1788846024.670369:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683484416 00000100:00100000:2.0:1788846024.670437:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00100000:2.0:1788846024.670449:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+53:12313:x1875740683484416:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846024.670473:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846024.670494:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272517 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754783 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.670661:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.670679:0:7876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.670688:0:7876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.670724:0:7876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 54 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.670738:0:7876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 54 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846024.670753:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34447bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702418432:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846024.670862:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846024.673737:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846024.673837:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683484544 00000100:00100000:0.0:1788846024.673846:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683484544 00010000:00010000:0.0:1788846024.673883:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 55 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846024.673940:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 86 00000100:00100000:0.0:1788846024.673950:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:2399:x1875740683484544:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846024.673963:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846024.673969:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 55 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.673983:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 55 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.674022:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846024.674028:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.674050:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.674057:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.674076:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846024.674130:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:2399:x1875740683484544:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 181us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846024.674138:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 86 00010000:00010000:2.0:1788846024.675186:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272502 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754775 expref: 54 pid: 6516 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846024.675206:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34447bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702418432:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846024.675229:0:7876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.675238:0:7876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.675325:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846024.675342:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788846024.675478:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272517 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 55 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.675493:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 54 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.675502:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846024.675505:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788846024.675508:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788846024.675651:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:12313:x1875740683484416:12345-192.168.203.20@tcp:101:bash.0 Request processed in 5203us (5527us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788846024.675659:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 175 00000100:00100000:1.0:1788846024.683626:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846024.684378:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683484800 00000100:00100000:0.0:1788846024.684390:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683484800 00000100:00100000:0.0:1788846024.684489:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 176 00000100:00100000:0.0:1788846024.684500:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:12313:x1875740683484800:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:0.0:1788846024.684744:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.684762:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.684774:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846024.684815:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:0.0:1788846024.684834:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000840a2122 reply state 0000000077dd3fee transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.684847:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.684871:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846024.684874:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846024.684877:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846024.685213:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:12313:x1875740683484800:12345-192.168.203.20@tcp:36:bash.0 Request processed in 713us (1594us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788846024.685220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 176 00000020:00080000:0.0:1788846024.685225:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788846024.691622:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846024.691701:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683484928 00000100:00100000:3.0:1788846024.691709:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683484928 00000100:00100000:3.0:1788846024.691764:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 177 00000100:00100000:3.0:1788846024.691774:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e450f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:12313:x1875740683484928:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846024.691798:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846024.691817:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272533 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175478a expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.691931:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.691947:0:12145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 58 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.691955:0:12145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.691998:0:12145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 58 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.692019:0:12145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 58 pid: 7876 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846024.692033:0:12145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702418560:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846024.692110:0:12145:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846024.697666:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846024.697754:0:12145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702418560:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846024.697780:0:12145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846024.697844:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683485056 00000100:00100000:0.0:1788846024.697850:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683485056 00010000:00010000:0.0:1788846024.697882:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 59 pid: 7876 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846024.697978:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 87 00000100:00100000:0.0:1788846024.698049:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:2398:x1875740683485056:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846024.698066:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846024.698073:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 59 pid: 7876 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.698085:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 59 pid: 7876 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.698106:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827251e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754783 expref: 59 pid: 7876 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.698121:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846024.698126:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.698148:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.698156:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.698218:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846024.698276:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:2398:x1875740683485056:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 290us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846024.698283:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 87 00010000:00010000:3.0:1788846024.703368:0:12145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.703386:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846024.703481:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788846024.703500:0:12145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846024.705359:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.705412:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272533 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175478a expref: 58 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.705433:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175478a expref: 57 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.705443:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846024.705446:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846024.705449:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065200, rc 0) 00000100:00100000:3.0:1788846024.705537:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e450f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:12313:x1875740683484928:12345-192.168.203.20@tcp:101:bash.0 Request processed in 13748us (13907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846024.705548:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 177 00000100:00100000:1.0:1788846024.711827:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846024.712117:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683485312 00000100:00100000:0.0:1788846024.712126:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683485312 00000100:00100000:0.0:1788846024.712185:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:0.0:1788846024.712195:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+57:12313:x1875740683485312:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:0.0:1788846024.712835:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:12313:x1875740683485312:12345-192.168.203.20@tcp:35:bash.0 Request processed in 638us (1015us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788846024.712844:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000040:00080000:0.0:1788846024.839151:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846024.841127:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846024.841317:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683485568 00000100:00100000:2.0:1788846024.841327:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683485568 00000100:00100000:2.0:1788846024.841395:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 178 00000100:00100000:2.0:1788846024.841407:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:12323:x1875740683485568:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846024.841431:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846024.841460:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272541 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754791 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846024.841699:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788846024.841801:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272541 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754791 expref: 60 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.841831:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:2.0:1788846024.841834:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846024.841840:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272541 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754791 expref: 60 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846024.841854:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c800, rc 0) 00000100:00100000:2.0:1788846024.841915:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:12323:x1875740683485568:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 511us (796us total) trans 4294967454 rc 301/301 00000100:00100000:2.0:1788846024.841923:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 178 00000100:00100000:2.0:1788846024.847410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846024.849031:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683485696 00000100:00100000:0.0:1788846024.849045:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683485696 00000100:00100000:0.0:1788846024.849115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 179 00000100:00100000:0.0:1788846024.849126:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:12323:x1875740683485696:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:0.0:1788846024.849201:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849217:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849242:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849254:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849261:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849266:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849353:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849363:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849369:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846024.849415:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849428:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849435:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849442:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849458:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846024.849463:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849471:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849482:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846024.849485:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846024.849489:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849495:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d5613827254f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849508:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849514:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849563:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849569:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846024.849572:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849578:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849596:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:0.0:1788846024.849599:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846024.849602:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849607:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272556 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849616:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849621:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849627:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849631:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846024.849633:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849640:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849646:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846024.849648:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846024.849650:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846024.849654:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827255d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846024.856640:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:12323:x1875740683485696:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 7504us (9228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846024.856655:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 179 00000100:00100000:0.0:1788846024.864651:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846024.864755:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683485952 00000100:00100000:3.0:1788846024.864765:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683485952 00000100:00100000:2.0:1788846024.865033:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:2.0:1788846024.865044:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:12323:x1875740683485952:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846024.865269:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:12323:x1875740683485952:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 226us (625us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788846024.865286:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:0.0:1788846024.946952:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846024.947086:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683486208 00000100:00100000:3.0:1788846024.947095:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683486208 00000100:00100000:3.0:1788846024.947161:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:3.0:1788846024.947171:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:12326:x1875740683486208:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846024.947194:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846024.947216:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272564 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754798 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947286:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947317:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947328:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947340:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947347:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947352:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947463:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272579 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947472:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272579 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947480:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272579 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846024.947489:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788846024.947596:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947603:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947609:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947621:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846024.947625:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947632:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947644:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846024.947646:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846024.947651:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947656:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827256b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947669:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947675:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947680:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947685:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846024.947688:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947694:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947713:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:3.0:1788846024.947716:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846024.947718:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947724:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272572 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947759:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272564 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754798 expref: 63 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947772:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272579 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754798 expref: 62 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.947780:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846024.947782:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846024.947785:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846024.947838:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:12326:x1875740683486208:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 668us (894us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788846024.947846:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 180 00000100:00100000:0.0:1788846024.951228:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846024.952416:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683486336 00000100:00100000:1.0:1788846024.952429:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683486336 00000100:00100000:1.0:1788846024.952503:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:1.0:1788846024.952515:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:12326:x1875740683486336:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:1.0:1788846024.952621:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952639:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952651:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952684:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952689:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952695:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952701:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846024.952705:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952712:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952742:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:1.0:1788846024.952745:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846024.952750:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846024.952756:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272587 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846024.952824:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:12326:x1875740683486336:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 312us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846024.952832:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 181 00000100:00100000:0.0:1788846024.958282:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846024.958369:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846024.958603:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683486464 00000100:00100000:3.0:1788846024.958612:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683486464 00000100:00100000:3.0:1788846024.958674:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:3.0:1788846024.958685:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:2401:x1875740683486464:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846024.958698:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846024.958722:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272579 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754798 expref: 62 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846024.958761:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846024.958766:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846024.958908:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:2401:x1875740683486464:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 223us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846024.958915:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1788846024.959168:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683486720 00000100:00100000:2.0:1788846024.959174:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683486720 00000100:00100000:2.0:1788846024.959244:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:2.0:1788846024.959252:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+61:12326:x1875740683486720:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846024.959426:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:12326:x1875740683486720:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 174us (1057us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788846024.959456:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:0.0:1788846025.143076:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.143188:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683486976 00000100:00100000:2.0:1788846025.143199:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683486976 00000100:00100000:2.0:1788846025.143262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:2.0:1788846025.143272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+62:12345:x1875740683486976:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1788846025.143307:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846025.143326:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d5613827258e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175479f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.143413:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272595 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.143424:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272595 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.143437:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272595 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846025.143448:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788846025.143607:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d5613827258e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175479f expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.143625:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272595 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175479f expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.143633:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846025.143636:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788846025.143640:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d800, rc 0) 00000100:00100000:2.0:1788846025.143707:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:12345:x1875740683486976:12345-192.168.203.20@tcp:101:cat.0 Request processed in 436us (640us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788846025.143715:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 182 00000100:00100000:1.0:1788846025.170683:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.170774:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683487104 00000100:00100000:2.0:1788846025.170785:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683487104 00000100:00100000:2.0:1788846025.170859:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:2.0:1788846025.170869:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:12346:x1875740683487104:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846025.170894:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846025.170914:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547a6 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.171017:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382725aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.171032:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382725aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.171043:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382725aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846025.171086:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788846025.171091:0:7876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846025.171112:0:7876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382725aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.171136:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547a6 expref: 66 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.171153:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382725aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547a6 expref: 65 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.171383:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:2.0:1788846025.171387:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846025.171390:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788846025.171644:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12346:x1875740683487104:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 775us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846025.171651:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 183 00000100:00100000:0.0:1788846025.180518:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.180649:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683487488 00000100:00100000:2.0:1788846025.180660:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683487488 00000100:00100000:2.0:1788846025.180717:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:2.0:1788846025.180727:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12346:x1875740683487488:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846025.181140:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12346:x1875740683487488:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 413us (629us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788846025.181148:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:0.0:1788846025.184107:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846025.184319:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683487616 00000100:00100000:1.0:1788846025.184328:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683487616 00000100:00100000:1.0:1788846025.184391:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:1.0:1788846025.184401:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12346:x1875740683487616:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:1.0:1788846025.184415:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788846025.184442:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827253a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175478a expref: 66 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.184467:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272595 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175479f expref: 65 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.184479:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272437 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754744 expref: 64 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.184489:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:1.0:1788846025.184508:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846025.184615:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:12346:x1875740683487616:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 215us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846025.184622:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:1.0:1788846025.187866:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.188099:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683487744 00000100:00100000:2.0:1788846025.188111:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683487744 00000100:00100000:2.0:1788846025.188252:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:2.0:1788846025.188263:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:12346:x1875740683487744:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:2.0:1788846025.188369:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.188386:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.188397:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846025.188786:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788846025.188871:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:12346:x1875740683487744:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 609us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846025.188878:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 184 00000100:00100000:2.0:1788846025.221948:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.222154:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683487872 00000100:00100000:3.0:1788846025.222175:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683487872 00000100:00100000:3.0:1788846025.222239:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 185 00000100:00100000:3.0:1788846025.222250:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:12348:x1875740683487872:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846025.222271:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846025.222290:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382725b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547ad expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222358:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222375:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222386:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222398:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222405:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222431:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222546:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222556:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222563:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846025.222607:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788846025.222612:0:12145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846025.222633:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222645:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222653:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222659:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222665:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222671:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846025.222675:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222690:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222705:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846025.222708:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846025.222713:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222719:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222743:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222749:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222754:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222759:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846025.222762:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222767:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222773:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:3.0:1788846025.222776:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846025.222779:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222794:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222821:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382725b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 65 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222835:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 64 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.222842:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846025.222845:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846025.222847:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065400, rc 0) 00000100:00100000:3.0:1788846025.222913:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:12348:x1875740683487872:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 665us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846025.222920:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 185 00000040:00080000:2.0:1788846025.466105:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788846025.466114:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846025.466153:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788846025.466162:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788846025.466306:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344479c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702418688:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788846025.466484:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846025.476407:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.476590:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683488000 00000100:00100000:3.0:1788846025.476601:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683488000 00000100:00100000:3.0:1788846025.476658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:3.0:1788846025.476669:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12359:x1875740683488000:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788846025.476708:0:6515:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788846025.476830:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12359:x1875740683488000:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 162us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846025.476838:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 186 00000100:00100000:0.0:1788846025.479076:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344479c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702418688:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788846025.490836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846025.491397:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683488128 00000100:00100000:0.0:1788846025.491408:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683488128 00000100:00100000:0.0:1788846025.491469:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:0.0:1788846025.491479:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:12359:x1875740683488128:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788846025.492361:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.492381:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.492394:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.492410:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.492417:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.492437:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.492467:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.492476:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.492483:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846025.493204:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788846025.493211:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846025.493317:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493333:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493341:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493348:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493355:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.493359:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493367:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493388:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:0.0:1788846025.493390:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846025.493395:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493402:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d561382725d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493417:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493423:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493429:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493434:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.493436:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493442:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493448:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff90e4514bda00) 00010000:00010000:0.0:1788846025.493451:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846025.493453:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493459:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d561382725db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493484:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493498:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493505:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493510:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.493513:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493536:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493544:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846025.493547:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846025.493550:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.493555:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382725e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846025.493642:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:12359:x1875740683488128:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 2161us (6712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846025.493652:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 187 00000100:00100000:2.0:1788846025.500073:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.500171:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683488384 00000100:00100000:3.0:1788846025.500181:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683488384 00000100:00100000:3.0:1788846025.502923:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:3.0:1788846025.503000:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:12359:x1875740683488384:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.503038:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846025.503060:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382725e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547b4 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503162:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503178:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503189:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846025.503200:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788846025.503411:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503420:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503428:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503433:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846025.503438:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503445:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503457:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846025.503466:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846025.503471:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503477:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382725f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.503552:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382725e9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547b4 expref: 66 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.504073:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:3.0:1788846025.504077:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788846025.504083:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382725e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547b4 expref: 66 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.504095:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846025.504168:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12359:x1875740683488384:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1174us (4101us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1788846025.504176:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 188 00000100:00100000:0.0:1788846025.514499:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.514598:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683488512 00000100:00100000:2.0:1788846025.514609:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683488512 00000100:00100000:2.0:1788846025.514661:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:2.0:1788846025.514672:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12359:x1875740683488512:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788846025.514717:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788846025.514839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12359:x1875740683488512:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 168us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846025.514847:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 189 00000100:00100000:2.0:1788846025.523152:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.523778:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683488768 00000100:00100000:3.0:1788846025.523788:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683488768 00000100:00100000:3.0:1788846025.523842:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:3.0:1788846025.523853:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12359:x1875740683488768:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.523873:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846025.523877:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788846025.523904:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382725aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547a6 expref: 65 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.523924:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846025.523954:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846025.523968:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788846025.524582:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788846025.525335:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272605 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.525353:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.525365:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272605 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.525420:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382725fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547bb expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.525439:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272605 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547bb expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.525447:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481b00) 00010000:00010000:3.0:1788846025.525450:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846025.525453:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064000, rc 0) 00000100:00100000:3.0:1788846025.525547:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12359:x1875740683488768:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 1695us (2405us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788846025.525555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 190 00000100:00100000:0.0:1788846025.531723:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.531924:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683489024 00000100:00100000:3.0:1788846025.531944:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683489024 00000100:00100000:3.0:1788846025.532005:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 191 00000100:00100000:3.0:1788846025.532026:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12359:x1875740683489024:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.532096:0:7876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846025.532123:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272605 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547bb expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532143:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481b00) 00010000:00010000:3.0:1788846025.532154:0:7876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846025.532177:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532191:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532200:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532378:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532389:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532396:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532442:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532450:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532456:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532470:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846025.532475:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532483:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532492:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846025.532495:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846025.532498:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532504:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272613 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532514:0:7876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532549:0:7876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532555:0:7876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532560:0:7876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846025.532562:0:7876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532568:0:7876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532587:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4eaa1bd5 (ffff90e461481100) 00010000:00010000:3.0:1788846025.532589:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846025.532592:0:7876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.532598:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827261a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4eaa1bd5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846025.532734:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12359:x1875740683489024:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 710us (1019us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788846025.532742:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 191 00010000:00010000:3.0:1788846025.539949:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846025.554207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.554420:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683489152 00000100:00100000:3.0:1788846025.554430:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683489152 00000100:00100000:3.0:1788846025.554623:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:3.0:1788846025.554636:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12359:x1875740683489152:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.554656:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846025.554677:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272621 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547c2 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.554722:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.554735:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.554747:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.554863:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272621 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 67 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.554880:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 66 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.554889:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:3.0:1788846025.554892:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788846025.554895:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846025.554966:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12359:x1875740683489152:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 333us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846025.557819:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 192 00000100:00100000:2.0:1788846025.565108:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.565172:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683489408 00000100:00100000:3.0:1788846025.565183:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683489408 00000100:00100000:3.0:1788846025.565249:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:3.0:1788846025.565259:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12359:x1875740683489408:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.565356:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.565374:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.565386:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846025.565670:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788846025.565681:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409603159345ns, next at 410603157355ns, rc = 0 00000004:00010000:3.0:1788846025.565742:0:6515:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c0695b2 reply state 0000000017020d70 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.565879:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.565889:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:3.0:1788846025.565892:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788846025.565896:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788846025.566005:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:12359:x1875740683489408:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 746us (905us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788846025.566022:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 193 00000100:00100000:3.0:1788846025.568077:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846025.568707:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683489536 00000100:00100000:1.0:1788846025.568716:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683489536 00000100:00100000:1.0:1788846025.568775:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:1.0:1788846025.568784:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:12359:x1875740683489536:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788846025.568804:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846025.568821:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547c9 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.568871:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 69 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.568884:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 69 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.568901:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:1.0:1788846025.568904:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788846025.568907:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2800, rc 0) 00000100:00100000:1.0:1788846025.568954:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+69:12359:x1875740683489536:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 172us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846025.568961:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 194 00000100:00100000:1.0:1788846025.571868:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.573624:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683489664 00000100:00100000:3.0:1788846025.573648:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683489664 00000100:00100000:3.0:1788846025.573737:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1788846025.573750:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+6:2401:x1875740683489664:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788846025.574130:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2401:x1875740683489664:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 382us (2268us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788846025.574139:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00080000:1.0:1788846025.574442:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788846025.590656:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846025.590791:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683489920 00000100:00100000:0.0:1788846025.590802:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683489920 00000100:00100000:0.0:1788846025.590852:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:0.0:1788846025.590863:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+69:12359:x1875740683489920:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788846025.591129:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+70:12359:x1875740683489920:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 265us (479us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788846025.591139:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:3.0:1788846025.598461:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846025.598561:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683490176 00000100:00100000:1.0:1788846025.598571:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683490176 00000100:00100000:1.0:1788846025.598644:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:1.0:1788846025.598654:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+70:12359:x1875740683490176:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788846025.598765:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+70:12359:x1875740683490176:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 112us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846025.598773:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 195 00000100:00100000:0.0:1788846025.601922:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.603264:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683490304 00000100:00100000:3.0:1788846025.603279:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683490304 00000100:00100000:3.0:1788846025.603344:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 196 00000100:00100000:3.0:1788846025.603355:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+70:12359:x1875740683490304:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.603375:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846025.603398:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827263d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547d0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.603484:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272644 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.603497:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.603509:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846025.603575:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846025.603596:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272644 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.603624:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d5613827263d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d0 expref: 72 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.603652:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272644 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d0 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.603661:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:3.0:1788846025.603663:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788846025.603667:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065800, rc 0) 00000100:00100000:3.0:1788846025.603739:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+71:12359:x1875740683490304:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 385us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846025.603746:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 196 00000100:00100000:0.0:1788846025.615079:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.615453:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683490432 00000100:00100000:2.0:1788846025.615464:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683490432 00000100:00100000:2.0:1788846025.615553:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:2.0:1788846025.615693:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2401:x1875740683490432:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846025.615712:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846025.615731:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547d7 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846025.615755:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9fc9, blocks: 0x0 00010000:00010000:2.0:1788846025.615785:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1788846025.615789:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846025.615798:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.615814:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.615828:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788846025.615883:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2401:x1875740683490432:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 192us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846025.618127:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1788846025.624338:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.624493:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683490688 00000100:00100000:2.0:1788846025.624503:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683490688 00000100:00100000:2.0:1788846025.624915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 197 00000100:00100000:2.0:1788846025.624939:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+71:12359:x1875740683490688:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788846025.625049:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+71:12359:x1875740683490688:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 123us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846025.633312:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.633361:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683490816 00000100:00100000:3.0:1788846025.633372:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683490816 00000100:00100000:3.0:1788846025.633430:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1788846025.633452:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:12359:x1875740683490816:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.633471:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846025.633489:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547de expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.633546:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.633557:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846025.633562:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846025.633567:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.633602:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.633615:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 9 pid: 8433 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846025.633629:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1875740702418816:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846025.633733:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846025.634751:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 197 00000100:00100000:1.0:1788846025.639665:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.639960:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1875740702418816:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846025.639994:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.640045:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064400, rc 0) 00000100:00100000:3.0:1788846025.640153:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:12359:x1875740683490816:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 6703us (6848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846025.640161:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1788846025.645198:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683490944 00000100:00100000:2.0:1788846025.645215:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683490944 00010000:00010000:1.0:1788846025.645293:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 9 pid: 8433 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846025.645335:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:1.0:1788846025.645344:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683490944:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846025.645360:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846025.645380:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 9 pid: 8433 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.645395:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 9 pid: 8433 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.645418:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d5613827264b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d7 expref: 9 pid: 8433 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.645441:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846025.645445:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846025.645454:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.645463:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.645503:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846025.645517:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875740702418944:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846025.646673:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846025.660769:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846025.660844:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683491072 00000100:00100000:0.0:1788846025.660854:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683491072 00002000:00100000:0.0:1788846025.660903:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90e34447aa00 x1875740683491072/t0(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:376/0 lens 504/0 e 0 to 0 dl 1788846036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788846025.660914:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e34447aa00 with x1875740683491072 ext(0->8) 00002000:00010000:0.0:1788846025.660920:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e34447aa00 00000100:00100000:0.0:1788846025.660959:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1788846025.660970:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34447aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2399:x1875740683491072:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788846025.661878:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6503:1875740702418944:192.168.203.20@tcp:105: 00010000:00010000:3.0:1788846025.661902:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846025.662022:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:2398:x1875740683490944:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 16678us (22366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846025.662033:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 88 00000100:00100000:2.0:1788846025.662202:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34447aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:2399:x1875740683491072:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 1232us (1441us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788846025.662211:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00002000:00100000:2.0:1788846025.662220:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff90e34447aa00 x1875740683491072/t4294967315(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:376/0 lens 504/448 e 0 to 0 dl 1788846036 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788846025.662230:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e34447aa00 with x1875740683491072 ext(0->8) 00002000:00010000:2.0:1788846025.662237:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e34447aa00 00000100:00100000:1.0:1788846025.672912:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846025.673033:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683491200 00000100:00100000:0.0:1788846025.673043:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683491200 00000100:00100000:0.0:1788846025.673432:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 198 00000100:00100000:0.0:1788846025.673443:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+71:12359:x1875740683491200:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788846025.675890:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1788846025.675908:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788846025.675967:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788846025.676000:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e341082c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788846025.676013:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d01c700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e47b685000 00000020:00080000:3.0:1788846025.676016:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d01c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e343938600 00000020:00080000:3.0:1788846025.676135:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788846025.676186:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788846025.676204:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702419072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788846025.676272:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846025.676326:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702419072 00000100:00100000:3.0:1788846025.676334:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702419072 00000100:00100000:3.0:1788846025.676386:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788846025.676395:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702419072:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788846025.676576:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702419200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788846025.676626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846025.676658:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702419200 00000100:00100000:1.0:1788846025.676662:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702419200 00000100:00100000:1.0:1788846025.676689:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788846025.676696:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702419200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788846025.676939:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788846025.676943:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788846025 00002000:00010000:1.0:1788846025.676945:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788846025.676947:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788846025 -> 1788846025 00002000:00010000:1.0:1788846025.676957:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788846025.676997:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702419200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 301us (370us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788846025.677014:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1788846025.677058:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e475c12300/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788846025.677064:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702419200:0@lo:2:osp-syn-1-0.0 00002000:00080000:3.0:1788846025.677148:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1788846025.677179:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f9fc7, atime: 0x6a9f9fc7, ctime: 0x6a9f9fc7, blocks: 0x8 00010000:00010000:3.0:1788846025.677187:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.677202:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:3.0:1788846025.677207:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846025.677213:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.677229:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.677239:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.677247:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.677270:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788846025.677373:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702419072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 980us (1101us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788846025.677380:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:0.0:1788846025.677634:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677644:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677650:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677663:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.677667:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677675:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677690:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90e4514bd800) 00010000:00010000:0.0:1788846025.677693:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846025.677697:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677704:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827237a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677723:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677730:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677736:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677742:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.677745:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677752:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677839:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846025.677841:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846025.677845:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677850:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272381 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677865:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677871:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677877:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677882:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.677885:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677890:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677897:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235000) 00010000:00010000:0.0:1788846025.677899:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846025.677902:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677909:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382723c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677932:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677939:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677945:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677951:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42dc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.677954:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677961:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.677970:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846025.677972:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846025.678069:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846025.678077:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.678086:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846025.678090:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.678099:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.678113:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.678120:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d91c3eb0/0x21b4d56138272659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.678136:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846025.678138:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846025.678139:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846025.678184:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788846025.678189:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846025.678314:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:12359:x1875740683491200:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 4871us (5406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846025.678323:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 198 00000004:00080000:3.0:1788846025.678367:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e3439d5180/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788846025.678382:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702419072:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788846025.678474:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678482:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d561382724c3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678496:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678502:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678508:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678541:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.678545:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678552:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678831:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846025.678834:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846025.678838:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678845:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382724e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678857:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678863:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678869:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678874:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.678877:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678884:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678902:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:0.0:1788846025.678904:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846025.678907:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678914:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827252c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678926:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678932:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678938:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678943:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846025.678946:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678951:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678958:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:0.0:1788846025.678961:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788846025.678964:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.678970:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827262f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846025.692279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.692477:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683491328 00000100:00100000:2.0:1788846025.692487:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683491328 00000100:00100000:2.0:1788846025.692665:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:2.0:1788846025.692675:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:2398:x1875740683491328:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788846025.696440:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1788846025.696461:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788846025.698865:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683491328:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 6181us (6583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846025.698879:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1788846025.707257:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846025.707534:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683491584 00000100:00100000:0.0:1788846025.707544:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683491584 00000100:00100000:0.0:1788846025.707602:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 199 00000100:00100000:0.0:1788846025.707612:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:12359:x1875740683491584:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788846025.707663:0:7876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846025.707689:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272644 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547d0 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.707706:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:0.0:1788846025.707711:0:7876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846025.707742:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.707756:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.707766:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846025.707904:0:7876:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b33011ed reply state 0000000009bb34c8 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.707917:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.707950:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:0.0:1788846025.707952:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846025.707955:0:7876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846025.708068:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:12359:x1875740683491584:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 458us (821us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1788846025.708076:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 199 00000100:00100000:1.0:1788846025.714399:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.715392:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683491712 00000100:00100000:3.0:1788846025.715411:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683491712 00000100:00100000:3.0:1788846025.715471:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:3.0:1788846025.715482:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683491712:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788846025.725252:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788846025.725260:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788846025 -> 1788846024 00002000:00010000:2.0:1788846025.725263:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788846023 00002000:00010000:2.0:1788846025.725265:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788846025 -> 1788846024 00002000:00010000:2.0:1788846025.725268:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788846025.725340:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683491712:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 9856us (10946us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788846025.725350:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:1.0:1788846025.737589:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.741614:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683491968 00000100:00100000:2.0:1788846025.741625:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683491968 00000100:00100000:2.0:1788846025.741682:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 200 00000100:00100000:2.0:1788846025.741692:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:12359:x1875740683491968:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788846025.741773:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.741792:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 20 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.741804:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.741836:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 20 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.741849:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 20 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846025.741862:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344479180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702419328:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846025.742147:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846025.746491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846025.746586:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683492096 00000100:00100000:0.0:1788846025.746595:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683492096 00010000:00010000:0.0:1788846025.746632:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 21 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846025.746674:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 89 00000100:00100000:0.0:1788846025.746683:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:2399:x1875740683492096:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846025.746697:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846025.746703:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 21 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.746716:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 21 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.746738:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:0.0:1788846025.746742:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.746752:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.746759:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.746788:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846025.746832:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:2399:x1875740683492096:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846025.746840:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 89 00010000:00010000:2.0:1788846025.747355:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c2 expref: 20 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846025.747372:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344479180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702419328:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846025.747395:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747403:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747408:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747455:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747462:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747481:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747487:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846025.747491:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747498:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747508:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:2.0:1788846025.747511:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788846025.747515:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.747545:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272667 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846025.747597:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:12359:x1875740683491968:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 5906us (10017us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788846025.747605:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 200 00000100:00100000:1.0:1788846025.752076:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.752254:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683492224 00000100:00100000:3.0:1788846025.752265:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683492224 00000100:00100000:3.0:1788846025.752329:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:3.0:1788846025.752342:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683492224:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.752394:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.752415:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.752423:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846025.752427:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846025.752432:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.752477:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.752492:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 8 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846025.752546:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1875740702419456:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846025.752619:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846025.757794:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1875740702419456:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846025.757837:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846025.759766:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846025.759879:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683492352 00000100:00100000:0.0:1788846025.759896:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683492352 00010000:00010000:0.0:1788846025.761553:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 9 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846025.761607:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 90 00000100:00100000:0.0:1788846025.761625:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683492352:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846025.761642:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846025.761664:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 9 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.761679:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 9 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.761702:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097b6213d/0x21b4d56138272652 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547de expref: 9 pid: 8432 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.761716:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846025.761720:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846025.761725:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.761751:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846025.761783:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846025.761831:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846025.761854:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683492352:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 234us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846025.761883:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 90 00010000:00010000:3.0:1788846025.761885:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.761928:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.761939:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.761949:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.761958:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846025.761963:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.762017:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.762044:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.762054:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be1326ca/0x21b4d5613827266e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846025.762194:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683492224:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 9852us (10124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846025.762209:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:1.0:1788846025.778134:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.778652:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683492608 00000100:00100000:3.0:1788846025.778663:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683492608 00000100:00100000:3.0:1788846025.778721:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 201 00000100:00100000:3.0:1788846025.778730:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:12359:x1875740683492608:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788846025.778808:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.778826:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.778836:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.778872:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.778896:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 19 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846025.778908:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702419584:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846025.779648:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846025.786738:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846025.788509:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702419584:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846025.788559:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846025.789578:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683492736 00000100:00100000:1.0:1788846025.789591:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683492736 00010000:00010000:1.0:1788846025.789783:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 20 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846025.789856:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 91 00000100:00100000:1.0:1788846025.789866:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344479180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:2399:x1875740683492736:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846025.789882:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846025.789889:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 20 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.789902:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 20 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.789926:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382724bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754767 expref: 20 pid: 6515 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.789940:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:1.0:1788846025.789945:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.789968:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.789976:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.790000:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846025.790070:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344479180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:2399:x1875740683492736:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 204us (3343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846025.790078:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 91 00010000:00010000:1.0:1788846025.790113:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.790121:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.790294:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.790307:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 19 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.790316:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.790344:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 19 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.790357:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 19 pid: 7876 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846025.791486:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702419712:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846025.791706:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484df6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846025.799342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846025.799388:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702419712:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846025.799399:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683492864 00000100:00100000:1.0:1788846025.799407:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683492864 00010000:00010000:0.0:1788846025.799421:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.799441:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 20 pid: 7876 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846025.799488:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 92 00000100:00100000:1.0:1788846025.799498:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:2399:x1875740683492864:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846025.799512:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846025.799544:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 20 pid: 7876 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.799556:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 20 pid: 7876 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.799577:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2800/0x21b4d56138272636 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547c9 expref: 20 pid: 7876 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.799591:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:1.0:1788846025.799596:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.799758:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.799777:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.799808:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846025.799857:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:2399:x1875740683492864:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 359us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846025.799865:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 92 00010000:00010000:2.0:1788846025.800422:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.800454:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846025.800594:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788846025.800707:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1788846025.800742:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788846025.800819:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344478700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1875740702419840:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788846025.800870:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846025.800898:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846025.801705:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702419840 00000100:00100000:0.0:1788846025.801713:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702419840 00000100:00100000:0.0:1788846025.801760:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788846025.801769:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1875740702419840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788846025.801859:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6516:x1875740702419840:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846025.801867:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788846025.802150:0:6516:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788846025.802156:0:6516:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e475c12300, transno 4294967316 00000100:00100000:2.0:1788846025.803033:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344478700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1875740702419840:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788846025.803187:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1788846025.803250:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344478700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1875740702419968:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788846025.803300:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846025.803342:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fc300 going to sleep for 11 seconds 00000100:00100000:1.0:1788846025.803399:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702419968 00000100:00100000:1.0:1788846025.803407:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702419968 00000100:00100000:1.0:1788846025.803453:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788846025.803462:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6516:x1875740702419968:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788846025.803612:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6516:x1875740702419968:12345-0@lo:1000:mdt00_001.0 Request processed in 137us (297us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788846025.803620:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788846025.803661:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344478700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6516:1875740702419968:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788846025.803694:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803704:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803710:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803716:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846025.803720:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803744:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803762:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:1.0:1788846025.803764:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788846025.803769:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803774:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827267c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803799:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803805:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803810:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803815:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846025.803818:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803823:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803830:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:1.0:1788846025.803832:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788846025.803835:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803850:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d561382725b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803872:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803886:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 22 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803894:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803918:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 22 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.803932:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 22 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846025.803944:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702420096:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846025.804018:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4484dff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846025.814401:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bad500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702420096:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846025.814431:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846025.816733:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846025.817276:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683492992 00000100:00100000:2.0:1788846025.817286:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683492992 00010000:00010000:2.0:1788846025.817429:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 23 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846025.817515:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 93 00000100:00100000:2.0:1788846025.817545:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:2398:x1875740683492992:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846025.817560:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846025.817567:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 23 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.817599:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 23 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.817626:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382725cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ad expref: 23 pid: 12145 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.817646:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:2.0:1788846025.817651:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.817661:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.817669:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.817705:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846025.817755:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846025.817771:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:2398:x1875740683492992:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 226us (1043us total) trans 0 rc 0/0 00010000:00010000:3.0:1788846025.817781:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846025.817790:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 93 00010000:00010000:3.0:1788846025.817812:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817823:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817831:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817838:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846025.817857:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817868:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817904:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846025.817908:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846025.817914:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817921:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d56138272683 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817940:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817947:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817953:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817960:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846025.817963:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817969:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817979:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e4514bd900) 00010000:00010000:3.0:1788846025.817982:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788846025.817985:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846025.817991:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272675 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846025.818725:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:12359:x1875740683492608:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 39987us (40590us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788846025.818742:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 201 00000020:00080000:3.0:1788846025.818749:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788846025.819702:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788846025.819710:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846025.820168:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788846025.820577:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788846025.825579:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846025.825657:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683493248 00000100:00100000:1.0:1788846025.825669:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683493248 00000100:00100000:1.0:1788846025.825730:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1788846025.825753:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:12359:x1875740683493248:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788846025.826070:0:6518:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788846025.826110:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:1.0:1788846025.826150:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.826168:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.826180:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.826188:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.826194:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.826200:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846025.826226:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788846025.826305:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:12359:x1875740683493248:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 554us (735us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788846025.826313:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000020:00080000:1.0:1788846025.826318:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788846025.826686:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846025.826694:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.826702:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846025.826706:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.826727:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.826740:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:2.0:1788846025.826742:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788846025.826746:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.826752:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d5613827268a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846025.826764:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846025.826766:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846025.826767:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846026.042498:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702420224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846026.042632:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846026.042757:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702420224 00000100:00100000:3.0:1788846026.042765:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702420224 00000100:00100000:3.0:1788846026.042827:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788846026.042837:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875740702420224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788846026.042875:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788846026.042927:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875740702420224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.042935:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788846026.043736:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702420352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846026.043787:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846026.043844:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702420352 00000100:00100000:3.0:1788846026.043850:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702420352 00000100:00100000:3.0:1788846026.043889:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788846026.043898:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702420352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788846026.043914:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788846026.044142:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702420352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 244us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.044150:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788846026.044171:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846026.044212:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702420352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846026.044250:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702420224:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788846026.149979:0:14651:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788846026.149992:0:14651:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846026.150279:0:14651:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788846026.150291:0:14651:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788846026.314233:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846026.314961:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683493504 00000100:00100000:0.0:1788846026.314971:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683493504 00000100:00100000:0.0:1788846026.315057:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:0.0:1788846026.315068:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:12369:x1875740683493504:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846026.315091:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846026.315114:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138272691 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547e5 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.315249:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272698 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.315265:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272698 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.315279:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272698 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846026.315292:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000100:00080000:3.0:1788846026.317514:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788846026.317682:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d56138272691 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547e5 expref: 26 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.317718:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272698 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547e5 expref: 25 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.317728:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846026.317731:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788846026.317735:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356400, rc 0) 00000100:00100000:0.0:1788846026.317816:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:12369:x1875740683493504:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 2749us (3592us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788846026.317825:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 202 00000100:00100000:2.0:1788846026.327757:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846026.327823:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683493632 00000100:00100000:3.0:1788846026.327833:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683493632 00000100:00100000:3.0:1788846026.327891:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:3.0:1788846026.327901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:12369:x1875740683493632:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:3.0:1788846026.327974:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.327990:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328011:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328027:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328034:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328042:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328139:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328147:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328154:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788846026.328202:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328226:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328233:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328239:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328245:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846026.328248:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328255:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328267:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846026.328270:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846026.328274:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328287:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382726a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328299:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328305:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328312:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328317:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846026.328320:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328327:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328335:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e441426600) 00010000:00010000:3.0:1788846026.328337:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846026.328340:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328346:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382726ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328360:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328366:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328377:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328381:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846026.328384:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328390:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328722:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e441426000) 00010000:00010000:3.0:1788846026.328725:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846026.328728:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.328734:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382726b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846026.328811:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:12369:x1875740683493632:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 910us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.328819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 203 00000100:00100000:3.0:1788846026.396948:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846026.397848:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683493888 00000100:00100000:1.0:1788846026.397860:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683493888 00000100:00100000:1.0:1788846026.397915:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:1.0:1788846026.397925:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:12372:x1875740683493888:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846026.397960:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846026.398044:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382726bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547ec expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398125:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398139:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398151:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398165:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398171:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398178:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398288:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398297:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398304:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846026.398312:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788846026.398875:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398885:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398891:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398897:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846026.398901:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398907:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398920:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:1.0:1788846026.398923:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846026.398927:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398932:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3800/0x21b4d561382726c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398945:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398951:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398957:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.398961:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846026.399051:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.399059:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.399068:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e475235900) 00010000:00010000:1.0:1788846026.399071:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846026.399074:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.399080:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3600/0x21b4d561382726c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.401171:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382726bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 28 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.401200:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 27 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.401209:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:2.0:1788846026.401211:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846026.401214:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2e00, rc 0) 00000100:00100000:2.0:1788846026.401286:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:12372:x1875740683493888:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 3361us (4345us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788846026.401308:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 204 00000100:00100000:3.0:1788846026.406675:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846026.406773:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683494016 00000100:00100000:0.0:1788846026.406783:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683494016 00000100:00100000:0.0:1788846026.406843:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:0.0:1788846026.406853:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4752adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:12372:x1875740683494016:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:0.0:1788846026.406922:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.406949:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.406960:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.407012:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.407020:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.407026:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.407032:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846026.407036:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.407044:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.407056:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:0.0:1788846026.407059:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846026.407064:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.407069:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846026.407141:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4752adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:12372:x1875740683494016:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 289us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846026.407155:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 205 00000100:00100000:1.0:1788846026.410563:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.410654:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683494272 00000100:00100000:2.0:1788846026.410664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683494272 00000100:00100000:2.0:1788846026.410734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1788846026.410743:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:12372:x1875740683494272:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846026.410961:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+28:12372:x1875740683494272:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 218us (446us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788846026.410969:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:2.0:1788846026.449123:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846026.450987:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683494528 00000100:00100000:1.0:1788846026.451013:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683494528 00000100:00100000:0.0:1788846026.451196:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 206 00000100:00100000:0.0:1788846026.451209:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+28:11904:x1875740683494528:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846026.451232:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846026.451253:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547f3 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.451431:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.451447:0:12145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.451456:0:12145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.451487:0:12145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.451501:0:12145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 29 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846026.452124:0:12145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702420480:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846026.452249:0:12145:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341082f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846026.457696:0:12145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702420480:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846026.457729:0:12145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846026.463288:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846026.463770:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683494656 00000100:00100000:0.0:1788846026.463781:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683494656 00010000:00010000:0.0:1788846026.463822:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 30 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846026.463881:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 94 00000100:00100000:0.0:1788846026.463891:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:2401:x1875740683494656:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846026.463905:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846026.463912:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 30 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.463926:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 30 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.463948:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2e00/0x21b4d561382726d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547ec expref: 30 pid: 6516 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.463963:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:0.0:1788846026.463968:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.463989:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.463997:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.464135:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846026.464198:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:2401:x1875740683494656:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 308us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846026.464206:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 94 00010000:00010000:2.0:1788846026.466104:0:12145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.466121:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846026.466143:0:12145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788846026.466843:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382726e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 30 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.466866:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 29 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.466893:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:2.0:1788846026.466897:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788846026.466900:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357600, rc 0) 00000100:00100000:2.0:1788846026.467024:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:11904:x1875740683494528:12345-192.168.203.20@tcp:101:bash.0 Request processed in 15817us (17909us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788846026.467041:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 206 00000100:00100000:2.0:1788846026.481774:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846026.481903:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683494784 00000100:00100000:3.0:1788846026.481912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683494784 00000100:00100000:3.0:1788846026.481973:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 207 00000100:00100000:3.0:1788846026.481983:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:11904:x1875740683494784:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846026.482014:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846026.482055:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382726fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217547fa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.482090:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272701 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.482104:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272701 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.482115:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272701 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.482223:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382726fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547fa expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.482242:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272701 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547fa expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.482250:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:3.0:1788846026.482253:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788846026.482256:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846026.482315:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:11904:x1875740683494784:12345-192.168.203.20@tcp:101:bash.0 Request processed in 334us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.482322:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 207 00000100:00100000:0.0:1788846026.486018:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846026.486115:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683495040 00000100:00100000:3.0:1788846026.486124:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683495040 00000100:00100000:3.0:1788846026.486188:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 208 00000100:00100000:3.0:1788846026.486199:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+30:11904:x1875740683495040:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:3.0:1788846026.486421:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.486457:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.486470:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788846026.486516:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1788846026.486904:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5f0ec79 reply state 00000000c6c14eee transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.486918:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.486926:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:3.0:1788846026.486929:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788846026.486933:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788846026.486987:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1788846026.487137:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+34:11904:x1875740683495040:12345-192.168.203.20@tcp:36:bash.0 Request processed in 938us (1134us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788846026.487144:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 208 00000020:00080000:3.0:1788846026.487150:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788846026.489951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.490136:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683495168 00000100:00100000:2.0:1788846026.490147:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683495168 00000100:00100000:2.0:1788846026.490202:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 209 00000100:00100000:2.0:1788846026.490213:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+34:11904:x1875740683495168:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846026.490233:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846026.490252:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827270f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754801 expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.490305:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827270f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754801 expref: 35 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.490319:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827270f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754801 expref: 35 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.490338:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:2.0:1788846026.490341:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846026.490345:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d800, rc 0) 00000100:00100000:2.0:1788846026.490595:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:11904:x1875740683495168:12345-192.168.203.20@tcp:101:bash.0 Request processed in 383us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846026.490616:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 209 00000100:00100000:2.0:1788846026.503190:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846026.503511:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683495296 00000100:00100000:3.0:1788846026.503594:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683495296 00000100:00100000:2.0:1788846026.503774:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:2.0:1788846026.503785:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:11904:x1875740683495296:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846026.503802:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846026.503822:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754808 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846026.503846:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9fc8, atime: 0x6a9f9fc7, ctime: 0x6a9f9fc8, blocks: 0x8 00010000:00010000:2.0:1788846026.503867:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1788846026.503872:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846026.503880:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.503898:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.503911:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d600, rc 0) 00000100:00100000:2.0:1788846026.503980:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:11904:x1875740683495296:12345-192.168.203.20@tcp:101:bash.0 Request processed in 188us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846026.503987:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:3.0:1788846026.506456:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846026.506631:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683495424 00000100:00100000:0.0:1788846026.506639:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683495424 00002000:00010000:0.0:1788846026.506676:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788846026.506681:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e343651f80 with x1875740683495424 ext(0->18446744073709551615) 00002000:00010000:0.0:1788846026.506693:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e343651f80. 00000100:00100000:0.0:1788846026.506731:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1788846026.506740:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683495424:12345-192.168.203.20@tcp:10:bash.0 00002000:00010000:0.0:1788846026.506982:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788846026.506986:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788846024 -> 1788846026 00002000:00010000:0.0:1788846026.506988:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788846023 -> 1788846023 00002000:00010000:0.0:1788846026.506991:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788846024 -> 1788846026 00002000:00010000:0.0:1788846026.506993:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788846026.507061:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683495424:12345-192.168.203.20@tcp:10:bash.0 Request processed in 321us (612us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788846026.507069:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00002000:00010000:0.0:1788846026.507073:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:0.0:1788846026.507076:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e343651f80 with x1875740683495424 ext(0->18446744073709551615) 00002000:00010000:0.0:1788846026.507080:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e343651f80. 00000100:00100000:3.0:1788846026.554400:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702420864:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.554479:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846026.554559:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702421376:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.554585:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846026.554604:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702421888:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.554636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846026.554658:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788846026.554664:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702420736:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.554684:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846026.554701:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702421248:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.554721:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846026.554741:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702421760:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.554762:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846026.554792:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702421888 00000100:00100000:3.0:1788846026.554800:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702421888 00000100:00100000:3.0:1788846026.554838:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702421760 00000100:00100000:3.0:1788846026.554930:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702421760 00000100:00100000:3.0:1788846026.554965:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788846026.555048:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702421888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.555102:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702421888:12345-0@lo:400:kworker.0 Request processed in 130us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.555110:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788846026.555127:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788846026.555134:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702421760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.555162:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702421760:12345-0@lo:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.555168:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788846026.555186:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846026.555212:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702421760:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.555223:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702421888:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.555248:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702421376 00000100:00100000:3.0:1788846026.555258:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702421376 00000100:00100000:3.0:1788846026.555288:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702420736 00000100:00100000:3.0:1788846026.555291:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702420736 00000100:00100000:3.0:1788846026.555305:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702421248 00000100:00100000:3.0:1788846026.555307:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702421248 00000100:00100000:3.0:1788846026.555321:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788846026.555327:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702421376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.555364:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702421376:12345-0@lo:400:kworker.0 Request processed in 37us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.555370:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788846026.555381:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788846026.555386:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702420736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.555412:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702420736:12345-0@lo:400:kworker.0 Request processed in 25us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.555417:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788846026.555426:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788846026.555431:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702421248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.555452:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702421248:12345-0@lo:400:kworker.0 Request processed in 21us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.555457:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1788846026.555468:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846026.555470:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846026.555484:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702420736:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.555492:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702421248:0@lo:400:kworker.0 00010000:00080000:3.0:1788846026.555503:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344577800 x1875740702421376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846026.555550:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702421376:0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.555837:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702420608:0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.555891:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846026.555927:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702421120:0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.555950:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846026.555986:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702421632:0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.556018:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846026.556038:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788846026.556051:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702420992:0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.556076:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846026.556094:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702421504:0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.556115:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846026.556140:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702421632 00000100:00100000:0.0:1788846026.556144:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702421632 00000100:00100000:0.0:1788846026.556174:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702420992 00000100:00100000:0.0:1788846026.556177:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702420992 00000100:00100000:0.0:1788846026.556187:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702421504 00000100:00100000:0.0:1788846026.556189:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702421504 00000100:00100000:0.0:1788846026.556201:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788846026.556206:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702421632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.556243:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702421632:12345-0@lo:400:kworker.0 Request processed in 36us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846026.556249:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788846026.556262:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788846026.556267:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702420992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.556292:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702420992:12345-0@lo:400:kworker.0 Request processed in 25us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846026.556298:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788846026.556308:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788846026.556313:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702421504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.556338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702421504:12345-0@lo:400:kworker.0 Request processed in 25us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846026.556344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:0.0:1788846026.556357:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788846026.556359:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846026.556386:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702420992:0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.556395:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702421504:0@lo:400:kworker.0 00010000:00080000:0.0:1788846026.556405:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344575500 x1875740702421632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846026.556414:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702421632:0@lo:400:kworker.0 00000100:00100000:2.0:1788846026.556626:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702420608 00000100:00100000:2.0:1788846026.556631:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702420608 00000100:00100000:2.0:1788846026.556670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788846026.556677:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702420608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846026.556724:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3641:x1875740702420608:12345-0@lo:400:kworker.0 Request processed in 48us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846026.556730:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788846026.556907:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702420864 00000100:00100000:1.0:1788846026.556912:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702420864 00000100:00100000:1.0:1788846026.556939:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702421120 00000100:00100000:1.0:1788846026.556942:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702421120 00000100:00100000:1.0:1788846026.556955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788846026.556961:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702420864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846026.557025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702420864:12345-0@lo:400:kworker.0 Request processed in 64us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846026.557031:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788846026.557045:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788846026.557051:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702421120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846026.557078:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702421120:12345-0@lo:400:kworker.0 Request processed in 28us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846026.557091:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00010000:1.0:1788846026.557146:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846026.557174:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702420864:0@lo:400:kworker.0 00000100:00100000:1.0:1788846026.558124:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702422016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846026.558171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846026.558264:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702422016 00000100:00100000:2.0:1788846026.558270:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702422016 00000100:00100000:2.0:1788846026.558310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788846026.558317:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702422016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846026.558346:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788846026.558399:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702422016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846026.558406:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788846026.558586:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702420608:0@lo:400:kworker.0 00000100:00100000:0.0:1788846026.558600:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702421120:0@lo:400:kworker.0 00000100:00100000:3.0:1788846026.558962:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702422016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846026.636954:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846026.642874:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683495552 00000100:00100000:0.0:1788846026.642891:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683495552 00000100:00100000:0.0:1788846026.643035:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 210 00000100:00100000:0.0:1788846026.643047:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:12386:x1875740683495552:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:0.0:1788846026.643122:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643139:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643150:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643166:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643173:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643179:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643271:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643281:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643289:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846026.643337:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643348:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643356:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643362:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643368:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846026.643372:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643379:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643391:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846026.643394:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846026.643398:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643412:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827271d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643426:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643432:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643437:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643442:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846026.643446:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643452:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643460:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e4514bd800) 00010000:00010000:0.0:1788846026.643463:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846026.643465:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643471:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272724 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643485:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643491:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643503:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643508:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846026.643510:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643517:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643569:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:0.0:1788846026.643572:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846026.643575:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.643580:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d5613827272b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846026.643681:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:12386:x1875740683495552:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 635us (6735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846026.643689:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 210 00000100:00100000:1.0:1788846026.698739:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846026.699842:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683495808 00000100:00100000:0.0:1788846026.699853:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683495808 00000100:00100000:2.0:1788846026.700182:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 211 00000100:00100000:2.0:1788846026.700193:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+35:12389:x1875740683495808:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846026.700212:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846026.700240:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272732 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175480f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700320:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700336:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700346:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700362:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700388:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700395:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700555:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272747 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700565:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700573:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272747 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846026.700582:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788846026.700651:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700659:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700666:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700671:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42dc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846026.700675:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700682:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700703:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:2.0:1788846026.700706:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846026.700711:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700717:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272739 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700730:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700736:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700742:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700747:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846026.700749:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700754:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700760:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e3424a3100) 00010000:00010000:2.0:1788846026.700763:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846026.700765:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700771:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272740 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700817:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272732 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175480f expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700830:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272747 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175480f expref: 37 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.700837:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:2.0:1788846026.700839:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788846026.700842:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c800, rc 0) 00000100:00100000:2.0:1788846026.700908:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:12389:x1875740683495808:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 717us (2180us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788846026.700922:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 211 00000100:00100000:1.0:1788846026.706476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.706959:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683495936 00000100:00100000:2.0:1788846026.707109:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683495936 00000100:00100000:2.0:1788846026.707231:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:2.0:1788846026.707243:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:12389:x1875740683495936:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1788846026.707369:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.707390:0:12145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 37 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.707401:0:12145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.707447:0:12145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 37 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.707476:0:12145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 37 pid: 12145 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846026.707494:0:12145:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702422144:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846026.707652:0:12145:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d6bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846026.711905:0:12145:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12145:1875740702422144:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846026.711947:0:12145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846026.713405:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.713556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683496192 00000100:00100000:2.0:1788846026.713569:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683496192 00000100:00100000:2.0:1788846026.713643:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:2.0:1788846026.713655:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:6167:x1875740683496192:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788846026.714307:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:6167:x1875740683496192:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 651us (907us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788846026.714316:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:1.0:1788846026.721645:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.722203:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683496320 00000100:00100000:2.0:1788846026.722220:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683496320 00010000:00010000:2.0:1788846026.722282:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 39 pid: 12145 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846026.722333:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:2.0:1788846026.722345:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:2401:x1875740683496320:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846026.722364:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846026.722391:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 39 pid: 12145 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.722406:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 39 pid: 12145 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.722627:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382726ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547f3 expref: 39 pid: 12145 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.722651:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:2.0:1788846026.722658:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.722668:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.722676:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.722720:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846026.722855:0:12145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.722865:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.722926:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.722943:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.722951:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.722958:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846026.722963:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.722980:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.722992:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:0.0:1788846026.722996:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846026.723008:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.723016:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138272755 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846026.723084:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:2401:x1875740683496320:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 739us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846026.723093:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 95 00000100:00100000:0.0:1788846026.723339:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:12389:x1875740683495936:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 16098us (16878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846026.723349:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 212 00000100:00100000:1.0:1788846026.727199:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.727302:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683496576 00000100:00100000:2.0:1788846026.727316:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683496576 00000100:00100000:2.0:1788846026.727422:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:2.0:1788846026.727444:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+37:12389:x1875740683496576:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846026.730287:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:12389:x1875740683496576:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 2831us (3087us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788846026.730327:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1788846026.833645:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846026.833746:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683496832 00000100:00100000:0.0:1788846026.833761:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683496832 00000100:00100000:0.0:1788846026.833859:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:0.0:1788846026.833881:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+38:12400:x1875740683496832:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:0.0:1788846026.833918:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846026.833969:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827275c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754816 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.834230:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.834248:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.834263:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.834278:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.834285:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.834291:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835132:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272771 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835153:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835164:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846026.835178:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788846026.835296:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835323:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835330:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835337:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846026.835343:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835351:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835366:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846026.835370:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846026.835385:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835392:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272763 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835410:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835416:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835421:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835427:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846026.835437:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835443:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835452:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e4514bd800) 00010000:00010000:0.0:1788846026.835454:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846026.835457:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835463:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827276a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835567:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827275c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754816 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835584:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272771 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754816 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.835592:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:0.0:1788846026.835594:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846026.835596:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357a00, rc 0) 00000100:00100000:0.0:1788846026.835684:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+40:12400:x1875740683496832:12345-192.168.203.20@tcp:101:cat.0 Request processed in 1814us (2053us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788846026.835692:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 213 00000100:00100000:0.0:1788846026.841089:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846026.841187:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683497088 00000100:00100000:3.0:1788846026.841201:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683497088 00000100:00100000:3.0:1788846026.841274:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1788846026.841287:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+40:12400:x1875740683497088:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:3.0:1788846026.843091:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+41:12400:x1875740683497088:12345-192.168.203.20@tcp:35:cat.0 Request processed in 1793us (2003us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788846026.843107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:1.0:1788846026.855714:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.855922:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683497344 00000100:00100000:2.0:1788846026.855937:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683497344 00000100:00100000:2.0:1788846026.856022:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:2.0:1788846026.856035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+41:12401:x1875740683497344:12345-192.168.203.20@tcp:36:rm.0 00010000:00010000:2.0:1788846026.856113:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788846026.856149:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827270f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754801 expref: 41 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856178:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272771 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754816 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856192:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272747 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175480f expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856205:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272701 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547fa expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856216:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:2.0:1788846026.856222:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846026.856260:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856277:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856288:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856822:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856836:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856844:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856954:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856964:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.856971:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846026.857273:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788846026.857285:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410894764310ns, next at 411894760960ns, rc = 0 00010000:00010000:2.0:1788846026.857357:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.857368:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.857376:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.857384:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.857407:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.857414:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.857442:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846026.857774:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846026.857787:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.857796:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846026.857803:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.857813:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.857828:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:1.0:1788846026.857831:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788846026.857835:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.857841:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d56138272794 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.857878:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846026.857880:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846026.857882:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846026.858057:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858065:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858071:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858076:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846026.858080:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858086:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858096:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:2.0:1788846026.858099:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788846026.858102:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858108:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827278d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858132:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858146:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858152:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858158:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846026.858161:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858166:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858175:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:2.0:1788846026.858177:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846026.858180:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858186:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d5613827277f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846026.858199:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057a88455 reply state 00000000b2ee9147 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858212:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.858219:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e3424a3100) 00010000:00010000:2.0:1788846026.858221:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846026.858224:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846026.859217:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:12401:x1875740683497344:12345-192.168.203.20@tcp:36:rm.0 Request processed in 3173us (3507us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788846026.859241:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 214 00000100:00100000:1.0:1788846026.931693:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846026.932714:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683497600 00000100:00100000:0.0:1788846026.932733:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683497600 00000100:00100000:0.0:1788846026.932833:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 215 00000100:00100000:0.0:1788846026.932864:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+39:12407:x1875740683497600:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846026.932909:0:12145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846026.932936:0:12145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827279b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175481d expref: -99 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933114:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933134:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933150:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933163:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933171:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933178:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788846026.933694:0:12145:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788846026.933873:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933887:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933895:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933947:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933956:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933963:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933970:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846026.933975:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.933984:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.934010:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846026.934014:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846026.934020:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.934026:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846026.934044:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d79713f9 reply state 000000003a480c29 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.934057:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.934063:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e3424a3100) 00010000:00010000:0.0:1788846026.934073:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846026.934077:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788846026.934127:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827279b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 42 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.934145:0:12145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 41 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846026.934153:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:0.0:1788846026.934155:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846026.934158:0:12145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356a00, rc 0) 00000100:00100000:0.0:1788846026.934247:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:12407:x1875740683497600:12345-192.168.203.20@tcp:101:bash.0 Request processed in 1385us (2570us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788846026.934256:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 215 00000100:00100000:0.0:1788846026.940755:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846026.940896:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683497728 00000100:00100000:3.0:1788846026.940910:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683497728 00000100:00100000:3.0:1788846026.941024:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:3.0:1788846026.941037:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2401:x1875740683497728:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846026.941062:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846026.941090:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754824 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846026.941123:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846026.941149:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:3.0:1788846026.941154:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846026.941166:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.941216:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846026.941232:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065800, rc 0) 00000100:00100000:3.0:1788846026.941314:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2401:x1875740683497728:12345-192.168.203.20@tcp:101:bash.0 Request processed in 280us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846026.941322:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00080000:0.0:1788846026.941631:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846026.947748:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.949152:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683497856 00000100:00100000:2.0:1788846026.949177:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683497856 00000100:00100000:2.0:1788846026.949286:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1788846026.949299:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:12407:x1875740683497856:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846026.949341:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846026.949369:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175482b expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.949415:0:8906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.949671:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846026.949678:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846026.949685:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 9 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.949734:0:8906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 9 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.949750:0:8906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846026.949769:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875740702422272:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846026.949903:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d6b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788846026.958778:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8906:1875740702422272:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846026.958830:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 9 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846026.958859:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440030200, rc 0) 00000100:00100000:2.0:1788846026.958962:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:12407:x1875740683497856:12345-192.168.203.20@tcp:101:bash.0 Request processed in 9664us (11226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846026.958981:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:0.0:1788846026.960951:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846026.961075:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683497984 00000100:00100000:1.0:1788846026.961089:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683497984 00010000:00010000:1.0:1788846026.961140:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846026.961190:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:1.0:1788846026.961202:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2399:x1875740683497984:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846026.961222:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846026.961249:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.961264:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.961294:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000128733c7/0x21b4d561382727be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754824 expref: 9 pid: 8432 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.961314:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846026.961320:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846026.961331:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.961364:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846026.961415:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846026.961507:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1875740702422400:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846026.961778:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450e573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846026.967290:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846026.968189:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683498240 00000100:00100000:2.0:1788846026.968201:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683498240 00000100:00100000:2.0:1788846026.968282:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:2.0:1788846026.968294:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+42:12407:x1875740683498240:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:0.0:1788846026.968864:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6503:1875740702422400:192.168.203.20@tcp:105: 00010000:00010000:0.0:1788846026.968899:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846026.968916:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:12407:x1875740683498240:12345-192.168.203.20@tcp:35:bash.0 Request processed in 623us (1639us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788846026.968928:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1788846026.968933:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2399:x1875740683497984:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 7729us (7987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846026.968945:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 96 00000100:00100000:3.0:1788846027.066211:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788846027.066242:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702422528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846027.066333:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846027.066638:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702422528 00000100:00100000:2.0:1788846027.066650:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702422528 00000100:00100000:2.0:1788846027.066731:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788846027.066743:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702422528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788846027.066798:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788846027.068285:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846027.068309:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846027.068386:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846027.068495:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702422528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1750us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846027.068511:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788846027.068560:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702422656 00000100:00100000:2.0:1788846027.068569:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702422656 00000100:00080000:3.0:1788846027.068603:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846027.068626:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788846027.068645:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702422656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788846027.068671:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788846027.068739:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702422656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846027.068830:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846027.070120:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702422528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788846027.078311:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788846027.156417:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.159285:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683498368 00000100:00100000:0.0:1788846027.159306:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683498368 00000100:00100000:0.0:1788846027.159487:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 216 00000100:00100000:0.0:1788846027.159501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+43:12423:x1875740683498368:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846027.159626:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846027.159660:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754832 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.159766:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382727d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.159783:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382727d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.159801:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382727d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846027.159858:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788846027.159863:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846027.159888:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382727d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.159916:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d561382727cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754832 expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.159940:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382727d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754832 expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.159951:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846027.159955:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846027.159959:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356000, rc 0) 00000100:00100000:0.0:1788846027.160372:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+44:12423:x1875740683498368:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 871us (3968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846027.160381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 216 00000100:00100000:1.0:1788846027.174402:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846027.187810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683498624 00000100:00100000:2.0:1788846027.187834:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683498624 00000100:00100000:2.0:1788846027.187930:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 217 00000100:00100000:2.0:1788846027.187943:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+44:12423:x1875740683498624:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846027.187982:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846027.188019:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382727da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754839 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.188179:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382727e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.188199:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382727e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.188214:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382727e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846027.188227:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788846027.188366:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382727da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754839 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.188392:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382727e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754839 expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.188429:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:2.0:1788846027.188433:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846027.188437:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e440031c00, rc 0) 00000100:00100000:2.0:1788846027.188584:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+46:12423:x1875740683498624:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 643us (14198us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788846027.188592:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 217 00000100:00100000:1.0:1788846027.193419:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846027.193725:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.193939:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683499008 00000100:00100000:3.0:1788846027.193951:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683499008 00000100:00100000:2.0:1788846027.194004:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683498880 00000100:00100000:2.0:1788846027.194011:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683498880 00000100:00100000:3.0:1788846027.194036:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788846027.194046:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:2398:x1875740683499008:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846027.194063:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788846027.194068:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 218 00000100:00100000:2.0:1788846027.194080:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:12423:x1875740683498880:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846027.194094:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031c00/0x21b4d561382727e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754839 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.194108:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846027.194115:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:3.0:1788846027.194119:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846027.194130:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382727ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754840 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.194190:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:2398:x1875740683499008:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 145us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.194199:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00010000:00010000:2.0:1788846027.194272:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382727f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.194288:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382727f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.194301:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382727f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846027.194314:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788846027.195809:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440030c00/0x21b4d561382727ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754840 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.195854:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382727f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754840 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.195866:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:3.0:1788846027.195869:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788846027.195873:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d000, rc 0) 00000100:00100000:3.0:1788846027.195964:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:12423:x1875740683498880:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1886us (2559us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1788846027.195972:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 218 00000100:00100000:1.0:1788846027.202825:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.203085:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683499136 00000100:00100000:3.0:1788846027.203099:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683499136 00000100:00100000:3.0:1788846027.203355:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:3.0:1788846027.203369:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683499136:12345-192.168.203.20@tcp:1:lfs.0 00010000:00010000:3.0:1788846027.203445:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.203474:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.203485:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788846027.203490:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788846027.203495:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.203616:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 8 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.203633:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 8 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.203652:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1875740702422784:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846027.203768:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846027.206865:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1875740702422784:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846027.206913:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.208272:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846027.208394:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683499264 00000100:00100000:2.0:1788846027.208408:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683499264 00002000:00100000:2.0:1788846027.208478:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90e344574a80 x1875740683499264/t0(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:378/0 lens 504/0 e 0 to 0 dl 1788846038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788846027.208562:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e344574a80 with x1875740683499264 ext(0->8) 00010000:00010000:2.0:1788846027.208573:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 9 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.208591:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 9 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846027.208599:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e344574a80 00000100:00100000:2.0:1788846027.208638:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1788846027.208649:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683499264:12345-192.168.203.20@tcp:4:lfs.0 00000100:00100000:3.0:1788846027.211050:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:2398:x1875740683499264:12345-192.168.203.20@tcp:4:lfs.0 Request processed in 2383us (2767us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788846027.212091:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00002000:00100000:3.0:1788846027.212112:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff90e344574a80 x1875740683499264/t4294967309(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:378/0 lens 504/448 e 0 to 0 dl 1788846038 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788846027.212125:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e344574a80 with x1875740683499264 ext(0->8) 00010000:00010000:3.0:1788846027.212140:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 11 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.212164:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 11 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846027.212195:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90e344574a80 00000100:00100000:2.0:1788846027.214140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.214335:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683499392 00000100:00100000:0.0:1788846027.214350:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683499392 00010000:00010000:0.0:1788846027.214408:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 11 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846027.214459:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 97 00000100:00100000:0.0:1788846027.214470:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:2401:x1875740683499392:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846027.214487:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788846027.214511:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788846027.214514:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788846027 00002000:00010000:0.0:1788846027.214517:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788846027 00002000:00010000:0.0:1788846027.214556:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788846027 00002000:00010000:0.0:1788846027.214559:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788846027.214567:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 11 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.214585:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 11 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.214616:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd81ae5e/0x21b4d561382727c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175482b expref: 11 pid: 8906 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.214636:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846027.214641:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846027.214648:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.214682:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.214718:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846027.214938:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:2401:x1875740683499392:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 469us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846027.214947:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 97 00010000:00010000:1.0:1788846027.215097:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.215110:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.215138:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.215157:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.215166:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.215174:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846027.215178:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.215188:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.215202:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.215210:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097b6213d/0x21b4d56138272804 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846027.215284:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683499136:12345-192.168.203.20@tcp:1:lfs.0 Request processed in 11918us (12476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846027.215293:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1788846027.220044:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.220176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683499648 00000100:00100000:3.0:1788846027.220190:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683499648 00000100:00100000:3.0:1788846027.220321:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:3.0:1788846027.220334:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+47:12423:x1875740683499648:12345-192.168.203.20@tcp:35:lfs.0 00000004:00010000:3.0:1788846027.220446:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382727f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754840 expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788846027.220739:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788846027.220776:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1788846027.221174:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:3.0:1788846027.221223:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.221244:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 51 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.221256:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.221299:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 51 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.221317:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 51 pid: 12145 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.221335:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875740702422912:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846027.221462:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846027.224944:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875740702422912:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846027.225002:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846027.225120:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.225581:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683499776 00000100:00100000:0.0:1788846027.225591:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683499776 00010000:00010000:0.0:1788846027.225642:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 52 pid: 12145 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846027.225724:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 98 00000100:00100000:0.0:1788846027.225736:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+52:2398:x1875740683499776:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846027.225754:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846027.225763:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 52 pid: 12145 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.225777:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 52 pid: 12145 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.225803:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d561382727b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175481d expref: 52 pid: 12145 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.225825:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:0.0:1788846027.225869:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.225882:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.225890:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.225931:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788846027.225971:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.226005:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846027.226030:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+51:2398:x1875740683499776:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 295us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846027.226039:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 98 00000001:00080000:1.0:1788846027.226167:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1788846027.226396:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788846027.226512:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702423040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788846027.226640:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846027.226678:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450e57780 going to sleep for 11 seconds 00000100:00100000:3.0:1788846027.226793:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702423040 00000100:00100000:3.0:1788846027.226802:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702423040 00000100:00100000:3.0:1788846027.226912:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788846027.226921:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1875740702423040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788846027.227041:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1875740702423040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.227051:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788846027.227072:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702423040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788846027.227215:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00080000:2.0:1788846027.227234:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846027.227400:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702423168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788846027.227433:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846027.227460:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450e57cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846027.227949:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702423168 00000100:00100000:2.0:1788846027.227958:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702423168 00000100:00100000:2.0:1788846027.228014:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788846027.228024:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875740702423168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788846027.229539:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6519:x1875740702423168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1495us (2083us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788846027.229556:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788846027.230244:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875740702423168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788846027.230372:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788846027.230447:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.230460:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.230468:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.230475:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.230480:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.230489:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.230556:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:3.0:1788846027.230560:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788846027.230566:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.230573:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827280b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788846027.230722:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788846027.230813:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788846027.230828:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411268306843ns, next at 412268303671ns, rc = 0 00000001:00080000:3.0:1788846027.230835:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:3.0:1788846027.230863:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bd800) 00010000:00010000:3.0:1788846027.230866:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788846027.230874:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d561382727f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754840 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.231025:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:12423:x1875740683499648:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 10693us (10996us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788846027.231034:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000020:00080000:3.0:1788846027.231039:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788846027.244329:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.244470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683499904 00000100:00100000:0.0:1788846027.244485:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683499904 00000100:00100000:0.0:1788846027.244613:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 219 00000100:00100000:0.0:1788846027.244626:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+54:12423:x1875740683499904:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:0.0:1788846027.244659:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846027.244695:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272812 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754847 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.244777:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272812 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754847 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.244795:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272812 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754847 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.244817:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:0.0:1788846027.244820:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846027.244843:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356a00, rc 0) 00000100:00100000:0.0:1788846027.244913:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:12423:x1875740683499904:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 291us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846027.244920:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 219 00000100:00100000:1.0:1788846027.248841:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846027.251828:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683500160 00000100:00100000:2.0:1788846027.252226:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683500160 00000100:00100000:2.0:1788846027.252348:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1788846027.252361:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+55:12423:x1875740683500160:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846027.253190:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+56:12423:x1875740683500160:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 826us (4359us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788846027.253201:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:1.0:1788846027.373469:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.373799:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683500288 00000100:00100000:0.0:1788846027.373813:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683500288 00000100:00100000:0.0:1788846027.373892:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 220 00000100:00100000:0.0:1788846027.373903:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+56:12433:x1875740683500288:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:0.0:1788846027.374017:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374041:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374058:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374072:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374081:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374088:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374182:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374191:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374218:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846027.374281:0:12145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374296:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374303:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374310:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374317:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846027.374321:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374330:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374343:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:0.0:1788846027.374346:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846027.374352:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374358:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d56138272819 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374385:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374398:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374404:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374410:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846027.374413:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374419:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374427:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e3424a3100) 00010000:00010000:0.0:1788846027.374430:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846027.374432:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374438:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272820 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374449:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374455:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374460:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374465:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846027.374474:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374893:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374908:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:0.0:1788846027.374912:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846027.374916:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.374924:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d56138272827 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846027.375121:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+56:12433:x1875740683500288:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 1216us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846027.375132:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 220 00000100:00100000:0.0:1788846027.432914:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.433153:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683500544 00000100:00100000:3.0:1788846027.433167:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683500544 00000100:00100000:3.0:1788846027.433250:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:3.0:1788846027.433263:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+56:12436:x1875740683500544:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846027.433303:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846027.433333:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827282e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175484e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.433609:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.433628:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.433641:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.433655:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.433662:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.433669:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.436242:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.436917:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.436947:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846027.437085:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788846027.437228:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437237:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437263:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437433:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065a00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.437438:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437447:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437463:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846027.437467:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.437472:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437479:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272835 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437499:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437505:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437510:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437515:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.437518:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437666:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437675:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e3424a3100) 00010000:00010000:3.0:1788846027.437678:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.437681:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437687:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d5613827283c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437761:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d5613827282e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437778:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.437785:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846027.437787:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846027.437790:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064400, rc 0) 00000100:00100000:3.0:1788846027.437892:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:12436:x1875740683500544:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 4629us (4991us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788846027.437903:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 221 00000100:00100000:3.0:1788846027.443021:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846027.447343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683500672 00000100:00100000:2.0:1788846027.447370:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683500672 00000100:00100000:2.0:1788846027.447463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:2.0:1788846027.447474:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:12436:x1875740683500672:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1788846027.447605:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447628:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447643:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447687:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447693:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447700:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447705:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846027.447710:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447718:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447751:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:2.0:1788846027.447753:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846027.447758:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.447765:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272851 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846027.447879:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:12436:x1875740683500672:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 406us (4872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846027.447887:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 222 00000100:00100000:1.0:1788846027.453769:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.453855:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683500928 00000100:00100000:3.0:1788846027.453869:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683500928 00000100:00100000:3.0:1788846027.453941:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1788846027.453953:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+58:12436:x1875740683500928:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:3.0:1788846027.454304:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:12436:x1875740683500928:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 353us (549us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788846027.454312:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:3.0:1788846027.539428:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846027.539686:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683501184 00000100:00100000:1.0:1788846027.539699:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683501184 00000100:00100000:1.0:1788846027.539822:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:1.0:1788846027.539835:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:12446:x1875740683501184:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1788846027.539868:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846027.539872:0:7876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788846027.539906:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382727d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754832 expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.539930:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:1.0:1788846027.539954:0:7876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788846027.539972:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138272858 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754855 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.540131:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.540150:0:7876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.540159:0:7876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.540197:0:7876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.540212:0:7876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 59 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846027.540228:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702423296:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846027.540407:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450e57b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846027.545913:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702423296:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846027.545955:0:7876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.546450:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.547163:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683501312 00000100:00100000:0.0:1788846027.547176:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683501312 00010000:00010000:0.0:1788846027.547228:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 60 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846027.547272:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 99 00000100:00100000:0.0:1788846027.547283:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:2399:x1875740683501312:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846027.547300:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846027.547308:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 60 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.547323:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 60 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.547371:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d56138272843 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175484e expref: 60 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.547392:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:0.0:1788846027.547398:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.547409:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.547418:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.548811:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846027.548917:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:2399:x1875740683501312:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1629us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846027.548929:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 99 00010000:00010000:3.0:1788846027.556290:0:7876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.556314:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846027.556344:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788846027.556730:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3400/0x21b4d56138272858 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 60 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.556759:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 59 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.556770:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846027.556773:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788846027.556777:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3e00, rc 0) 00000100:00100000:3.0:1788846027.556934:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:12446:x1875740683501184:12345-192.168.203.20@tcp:101:bash.0 Request processed in 17100us (17520us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788846027.556954:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 223 00000100:00100000:3.0:1788846027.568000:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.570340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683501440 00000100:00100000:0.0:1788846027.570362:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683501440 00000100:00100000:0.0:1788846027.570826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 224 00000100:00100000:0.0:1788846027.570843:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+59:12446:x1875740683501440:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846027.570875:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846027.570902:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827286d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175485c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.570950:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.570991:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.571016:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.571163:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827286d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.571188:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.571198:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:0.0:1788846027.571201:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846027.571206:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357a00, rc 0) 00000100:00100000:0.0:1788846027.571310:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:12446:x1875740683501440:12345-192.168.203.20@tcp:101:bash.0 Request processed in 471us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846027.571319:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 224 00010000:00010000:2.0:1788846027.577800:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846027.582926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.583050:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683501696 00000100:00100000:0.0:1788846027.583075:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683501696 00000100:00100000:0.0:1788846027.583157:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 225 00000100:00100000:0.0:1788846027.583170:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+60:12446:x1875740683501696:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:0.0:1788846027.583476:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.583499:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.583585:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846027.583638:0:12145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1788846027.583665:0:12145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb637f34 reply state 000000007fed4e17 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.583679:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.583687:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:0.0:1788846027.583689:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846027.583693:0:12145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846027.583802:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:12446:x1875740683501696:12345-192.168.203.20@tcp:36:bash.0 Request processed in 634us (890us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788846027.583811:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 225 00000020:00080000:0.0:1788846027.583817:0:12145:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788846027.587650:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.587754:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683501824 00000100:00100000:3.0:1788846027.587770:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683501824 00000100:00100000:3.0:1788846027.587849:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 226 00000100:00100000:3.0:1788846027.587861:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:12446:x1875740683501824:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846027.587893:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846027.587920:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272882 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754863 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.588086:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.588105:0:7876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 64 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.588115:0:7876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.588158:0:7876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 64 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.588174:0:7876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 64 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.588190:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702423424:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846027.588320:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788846027.594961:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702423424:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846027.595022:0:7876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846027.595347:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.595618:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683501952 00000100:00100000:0.0:1788846027.595629:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683501952 00010000:00010000:0.0:1788846027.595680:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 65 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846027.595727:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 100 00000100:00100000:0.0:1788846027.595739:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:2399:x1875740683501952:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846027.595758:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846027.595766:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 65 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.595795:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 65 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.595827:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827285f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754855 expref: 65 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.595848:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:0.0:1788846027.595854:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.595866:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.595875:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.595914:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846027.596005:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:2399:x1875740683501952:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 259us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846027.596015:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 100 00010000:00010000:1.0:1788846027.596237:0:7876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.596245:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846027.596412:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788846027.596418:0:7876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846027.596446:0:7876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.596487:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272882 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 64 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.596507:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 63 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.596515:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:1.0:1788846027.596518:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846027.597349:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065200, rc 0) 00000100:00100000:1.0:1788846027.597437:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:12446:x1875740683501824:12345-192.168.203.20@tcp:101:bash.0 Request processed in 9573us (9798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846027.597446:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 226 00000100:00100000:1.0:1788846027.605803:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.606081:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683502208 00000100:00100000:3.0:1788846027.606095:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683502208 00000100:00100000:3.0:1788846027.606176:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:3.0:1788846027.606189:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+63:12446:x1875740683502208:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:3.0:1788846027.606607:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:12446:x1875740683502208:12345-192.168.203.20@tcp:35:bash.0 Request processed in 417us (815us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788846027.606616:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1788846027.693744:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.693932:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683502336 00000100:00100000:3.0:1788846027.693947:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683502336 00000100:00100000:3.0:1788846027.694035:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 227 00000100:00100000:3.0:1788846027.694049:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+64:12452:x1875740683502336:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846027.694083:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846027.694111:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272890 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175486a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.694203:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272897 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.694221:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.694235:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846027.694298:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788846027.694303:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846027.694328:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.694373:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d56138272890 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175486a expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.694393:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272897 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175486a expref: 65 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.694403:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846027.694406:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846027.694410:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065800, rc 0) 00000100:00100000:3.0:1788846027.694492:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12452:x1875740683502336:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 446us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.694499:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 227 00000100:00100000:2.0:1788846027.701716:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.701804:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683502464 00000100:00100000:3.0:1788846027.701820:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683502464 00000100:00100000:3.0:1788846027.701914:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 228 00000100:00100000:3.0:1788846027.701926:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12452:x1875740683502464:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846027.701956:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846027.701983:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d5613827289e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754871 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702078:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702096:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702108:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702138:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702147:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702167:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702275:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702285:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702293:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846027.702348:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788846027.702354:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846027.702379:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702393:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702401:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702408:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702426:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702433:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.702439:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702447:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702462:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846027.702467:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.702471:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702478:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702495:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702501:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702507:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702512:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.702516:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702590:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702599:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e3424a3100) 00010000:00010000:3.0:1788846027.702601:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.702604:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702609:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702643:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d5613827289e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702657:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.702665:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846027.702667:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846027.702669:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064400, rc 0) 00000100:00100000:3.0:1788846027.702745:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12452:x1875740683502464:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 821us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.702754:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 228 00000100:00100000:1.0:1788846027.713606:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.713888:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683502720 00000100:00100000:3.0:1788846027.713901:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683502720 00000100:00100000:3.0:1788846027.713978:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 229 00000100:00100000:3.0:1788846027.713989:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12452:x1875740683502720:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846027.714147:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846027.714180:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754878 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.714336:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.714355:0:7876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 67 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.714364:0:7876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.714373:0:7876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.714421:0:7876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.714438:0:7876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 67 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.714454:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702423552:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846027.714620:0:7876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 67 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.714630:0:7876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 67 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.714653:0:7876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702423680:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846027.714682:0:7876:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541600 going to sleep for 11 seconds 00000100:00100000:0.0:1788846027.723026:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846027.723198:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683502848 00000100:00100000:1.0:1788846027.723213:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683502848 00010000:00010000:1.0:1788846027.723271:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 68 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.723343:0:7876:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.20@tcp) returned -22 from blocking AST (req@000000001c85300e x1875740702423552) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 68 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.723366:0:7876:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 68 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.723396:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754871 expref: 68 pid: 6516 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.723419:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702423552:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846027.723421:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 101 00000100:00100000:0.0:1788846027.723442:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:2398:x1875740683502848:12345-192.168.203.20@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788846027.723444:0:7876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7876:1875740702423680:192.168.203.20@tcp:104: 00010000:00010000:0.0:1788846027.723467:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846027.723472:0:6502:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 21b4d561382728b3) 00010000:00010000:0.0:1788846027.723475:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846027.723486:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846027.723493:0:7876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.723518:0:7876:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846027.723690:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:2398:x1875740683502848:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 254us (678us total) trans 0 rc 116/116 00000100:00100000:0.0:1788846027.723699:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 101 00010000:00010000:3.0:1788846027.724125:0:7876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846027.727123:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.727215:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683502976 00000100:00100000:3.0:1788846027.727229:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683502976 00010000:00010000:3.0:1788846027.727308:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 67 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.727361:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 102 00000100:00100000:3.0:1788846027.727372:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:2399:x1875740683502976:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846027.727392:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846027.727401:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 67 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.727416:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 67 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.727444:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d56138272889 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754863 expref: 67 pid: 7876 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.727465:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846027.727471:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.727481:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.727490:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.727550:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846027.727772:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:2399:x1875740683502976:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 401us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.727780:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 102 00010000:00010000:2.0:1788846027.727977:0:7876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.727988:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846027.728021:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788846027.728200:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 67 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.728221:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 66 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.728230:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:2.0:1788846027.728233:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788846027.728243:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065a00, rc 0) 00000100:00100000:2.0:1788846027.728294:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12452:x1875740683502720:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 14306us (14713us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788846027.728303:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 229 00000100:00100000:2.0:1788846027.734319:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846027.734441:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683503232 00000100:00100000:1.0:1788846027.734456:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683503232 00000100:00100000:1.0:1788846027.734757:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:1.0:1788846027.734770:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12452:x1875740683503232:12345-192.168.203.20@tcp:103:lfs.0 00010000:00010000:1.0:1788846027.734810:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846027.734843:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272812 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754847 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846027.734880:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:1.0:1788846027.734886:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846027.734965:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12452:x1875740683503232:12345-192.168.203.20@tcp:103:lfs.0 Request processed in 198us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846027.734974:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1788846027.738556:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.738981:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683503360 00000100:00100000:3.0:1788846027.739001:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683503360 00000100:00100000:3.0:1788846027.739089:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 230 00000100:00100000:3.0:1788846027.739102:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12452:x1875740683503360:12345-192.168.203.20@tcp:58:lfs.0 00010000:00010000:3.0:1788846027.739258:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.739281:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.739296:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846027.739421:0:12145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788846027.739557:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12452:x1875740683503360:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 457us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.739568:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 230 00000100:00100000:2.0:1788846027.742989:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.743099:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683503488 00000100:00100000:3.0:1788846027.743116:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683503488 00000100:00100000:3.0:1788846027.743209:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 231 00000100:00100000:3.0:1788846027.743221:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+65:12452:x1875740683503488:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846027.743248:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846027.743277:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175487f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.743356:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.743371:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.743419:0:6517:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.743439:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.743460:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846027.743466:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846027.743470:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.743479:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064400, rc 0) 00000100:00100000:3.0:1788846027.743719:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12452:x1875740683503488:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 500us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.743726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 231 00000040:00080000:3.0:1788846027.902304:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788846027.902317:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846027.902351:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788846027.902365:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788846027.902585:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702423808:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788846027.902729:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541600 going to sleep for 11 seconds 00000100:00100000:2.0:1788846027.911583:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846027.911696:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683503616 00000100:00100000:1.0:1788846027.911709:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683503616 00000100:00100000:1.0:1788846027.911792:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:1.0:1788846027.911806:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:12453:x1875740683503616:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788846027.911850:0:7876:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788846027.912028:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:12453:x1875740683503616:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 224us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846027.912037:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 232 00000100:00100000:3.0:1788846027.912785:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702423808:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788846027.917587:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.918047:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683503744 00000100:00100000:3.0:1788846027.918062:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683503744 00000100:00100000:3.0:1788846027.918145:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00100000:3.0:1788846027.918158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3444a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12453:x1875740683503744:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788846027.918515:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919335:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919352:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919389:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919400:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919406:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919448:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919459:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919466:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846027.919557:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788846027.919563:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846027.919581:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919594:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919615:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919621:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919627:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.919632:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.919641:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920309:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:3.0:1788846027.920315:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.920321:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920329:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382728dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920350:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920357:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920363:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920369:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.920384:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920391:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920401:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff90e441426500) 00010000:00010000:3.0:1788846027.920404:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.920407:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920413:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382728e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920442:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920448:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920454:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920460:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.920463:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920469:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920478:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846027.920481:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.920490:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.920496:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382728eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.920700:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3444a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12453:x1875740683503744:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 2538us (3120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.920711:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 233 00000100:00100000:2.0:1788846027.925908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846027.926201:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683504000 00000100:00100000:0.0:1788846027.926215:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683504000 00000100:00100000:0.0:1788846027.926395:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:0.0:1788846027.926409:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+66:12453:x1875740683504000:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846027.926436:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846027.926463:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382728f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754886 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926634:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926666:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926684:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846027.926697:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788846027.926803:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926812:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926818:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926824:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846027.926841:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926849:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926866:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:0.0:1788846027.926869:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788846027.926874:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926882:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382728f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926932:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382728f2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754886 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926944:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:0.0:1788846027.926946:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788846027.926950:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d561382728f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754886 expref: 68 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846027.926971:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356000, rc 0) 00000100:00100000:0.0:1788846027.927188:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:12453:x1875740683504000:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 780us (1292us total) trans 4294967506 rc 301/301 00000100:00100000:0.0:1788846027.927196:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 234 00000100:00100000:1.0:1788846027.930619:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846027.930779:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683504128 00000100:00100000:2.0:1788846027.930793:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683504128 00000100:00100000:2.0:1788846027.930874:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 235 00000100:00100000:2.0:1788846027.930885:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:12453:x1875740683504128:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788846027.930931:0:7876:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788846027.931493:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:12453:x1875740683504128:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 607us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846027.931503:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 235 00000100:00100000:3.0:1788846027.936702:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846027.936902:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683504384 00000100:00100000:2.0:1788846027.936918:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683504384 00000100:00100000:2.0:1788846027.937013:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 236 00000100:00100000:2.0:1788846027.937025:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:12453:x1875740683504384:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846027.937054:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846027.937057:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788846027.937093:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d56138272897 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175486a expref: 67 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.937144:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:2.0:1788846027.937151:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846027.937169:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272907 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175488d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788846027.938346:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788846027.939335:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827290e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.939358:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827290e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.939912:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827290e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.940085:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138272907 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175488d expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.940111:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827290e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175488d expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.940122:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3700) 00010000:00010000:2.0:1788846027.940125:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846027.940129:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788846027.941848:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:12453:x1875740683504384:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 4808us (5144us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788846027.941974:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 236 00000100:00100000:1.0:1788846027.947465:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.947670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683504640 00000100:00100000:3.0:1788846027.947684:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683504640 00000100:00100000:3.0:1788846027.947750:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 237 00000100:00100000:3.0:1788846027.947760:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:12453:x1875740683504640:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788846027.947837:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846027.947870:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827290e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175488d expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.947892:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3700) 00010000:00010000:3.0:1788846027.947903:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846027.949242:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.949268:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.949281:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.951936:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.951974:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.951986:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952049:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952057:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952064:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952070:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.952074:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952083:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952097:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:3.0:1788846027.952100:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.952104:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952110:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827291c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952126:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952138:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952143:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952148:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846027.952152:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952158:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952166:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xf797df60 (ffff90e441426500) 00010000:00010000:3.0:1788846027.952168:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846027.952171:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.952177:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272923 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xf797df60 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846027.953090:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:12453:x1875740683504640:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 5325us (5632us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788846027.953101:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 237 00000100:00100000:1.0:1788846027.956680:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846027.956719:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683504768 00000100:00100000:2.0:1788846027.956733:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683504768 00000100:00100000:2.0:1788846027.961280:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 238 00000100:00100000:2.0:1788846027.961318:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44997fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+67:12453:x1875740683504768:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846027.961350:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846027.961387:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d5613827292a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754894 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.961439:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.961456:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.961471:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.964793:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d5613827292a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 69 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.964829:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 68 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846027.964841:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:2.0:1788846027.964844:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846027.964848:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d800, rc 0) 00000100:00100000:2.0:1788846027.964955:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44997fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:12453:x1875740683504768:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3656us (8287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846027.964965:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 238 00000100:00100000:0.0:1788846027.969894:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.970621:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683505024 00000100:00100000:3.0:1788846027.970643:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683505024 00000100:00100000:3.0:1788846027.970752:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 239 00000100:00100000:3.0:1788846027.970767:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+68:12453:x1875740683505024:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788846027.970893:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.970935:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.970954:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846027.971438:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788846027.971451:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412008929905ns, next at 413008926842ns, rc = 0 00000004:00010000:3.0:1788846027.971723:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c316f28 reply state 00000000f38e75f3 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.971745:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.971756:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:3.0:1788846027.971759:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788846027.971764:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846027.972930:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+70:12453:x1875740683505024:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 2154us (3041us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1788846027.974565:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 239 00000100:00100000:1.0:1788846027.980942:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846027.981796:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683505152 00000100:00100000:3.0:1788846027.981813:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683505152 00000100:00100000:3.0:1788846027.981902:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 240 00000100:00100000:3.0:1788846027.981915:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+70:12453:x1875740683505152:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846027.981949:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846027.981978:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175489b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.982070:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.982089:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 71 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846027.982133:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:3.0:1788846027.982136:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846027.982141:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065400, rc 0) 00000100:00100000:3.0:1788846027.982235:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+71:12453:x1875740683505152:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 322us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846027.982243:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 240 00000100:00100000:1.0:1788846027.989342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846027.989662:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683505280 00000100:00100000:2.0:1788846027.989676:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683505280 00000100:00100000:2.0:1788846027.989772:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:2.0:1788846027.989784:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2398:x1875740683505280:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788846027.990092:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:2398:x1875740683505280:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 309us (764us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788846027.990100:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00080000:3.0:1788846027.990179:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846028.004926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846028.005059:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683505536 00000100:00100000:2.0:1788846028.005074:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683505536 00000100:00100000:2.0:1788846028.005185:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:2.0:1788846028.005197:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+71:12453:x1875740683505536:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00080000:3.0:1788846028.005678:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846028.005954:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+72:12453:x1875740683505536:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 756us (1038us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788846028.005963:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:0.0:1788846028.012772:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846028.015201:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683505792 00000100:00100000:1.0:1788846028.015374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683505792 00000100:00100000:1.0:1788846028.015742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 241 00000100:00100000:1.0:1788846028.015757:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+72:12453:x1875740683505792:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788846028.016007:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+72:12453:x1875740683505792:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 252us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.016024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 241 00000100:00100000:3.0:1788846028.021711:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846028.024726:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683505920 00000100:00100000:0.0:1788846028.024751:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683505920 00000100:00100000:0.0:1788846028.024876:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:0.0:1788846028.024892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+72:12453:x1875740683505920:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846028.029972:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846028.030328:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272946 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548a2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.030447:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827294d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.030466:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827294d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.030919:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827294d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846028.031724:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846028.031758:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827294d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.031809:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d56138272946 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a2 expref: 74 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.031832:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827294d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a2 expref: 73 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.031872:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:0.0:1788846028.031875:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788846028.031880:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356a00, rc 0) 00000100:00100000:0.0:1788846028.032478:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+73:12453:x1875740683505920:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 7587us (10779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846028.032498:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 242 00000100:00100000:2.0:1788846028.045769:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846028.045905:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683506048 00000100:00100000:1.0:1788846028.045919:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683506048 00000100:00100000:1.0:1788846028.048028:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:1.0:1788846028.048060:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+10:2401:x1875740683506048:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788846028.048087:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846028.048122:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548a9 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788846028.048158:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f9fcc, blocks: 0x0 00010000:00010000:1.0:1788846028.048188:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1788846028.048194:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846028.048216:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.048243:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.048268:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3e00, rc 0) 00000100:00100000:1.0:1788846028.048375:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:2401:x1875740683506048:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 331us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.048382:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:1.0:1788846028.053573:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.053938:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683506304 00000100:00100000:3.0:1788846028.053952:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683506304 00000100:00100000:3.0:1788846028.054186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 243 00000100:00100000:3.0:1788846028.054199:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+73:12453:x1875740683506304:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788846028.054380:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+73:12453:x1875740683506304:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 183us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846028.054389:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 243 00000100:00100000:0.0:1788846028.061195:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846028.061580:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683506432 00000100:00100000:2.0:1788846028.061595:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683506432 00000100:00100000:2.0:1788846028.061682:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:2.0:1788846028.061695:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+11:12453:x1875740683506432:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846028.061720:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846028.061746:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548b0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.061789:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 12 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.061823:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846028.061828:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846028.061834:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.061879:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 12 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.061896:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 12 pid: 8433 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.061912:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875740702423936:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846028.062048:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d6b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788846028.066773:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875740702423936:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846028.066824:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.066853:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c800, rc 0) 00000100:00100000:2.0:1788846028.066921:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:12453:x1875740683506432:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 5229us (5746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846028.066931:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:0.0:1788846028.068383:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.071755:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683506560 00000100:00100000:3.0:1788846028.071777:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683506560 00010000:00010000:2.0:1788846028.072226:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 12 pid: 8433 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846028.072406:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:0.0:1788846028.072423:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:2399:x1875740683506560:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846028.072443:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846028.072471:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 12 pid: 8433 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.072501:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 12 pid: 8433 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.072566:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ef99ebd/0x21b4d56138272954 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a9 expref: 12 pid: 8433 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.072588:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846028.072594:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846028.072790:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.072817:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.072868:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846028.072886:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1875740702424064:192.168.203.20@tcp:105: 00000100:00100000:0.0:1788846028.073032:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3410820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846028.080138:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.080454:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683506688 00000100:00100000:3.0:1788846028.080466:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683506688 00002000:00100000:3.0:1788846028.080564:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff90e343bac000 x1875740683506688/t0(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:379/0 lens 504/0 e 0 to 0 dl 1788846039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788846028.080577:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e343bac000 with x1875740683506688 ext(0->12) 00002000:00010000:3.0:1788846028.080585:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e343bac000 00000100:00100000:3.0:1788846028.080620:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1788846028.080649:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+12:2399:x1875740683506688:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788846028.083968:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:2399:x1875740683506688:12345-192.168.203.20@tcp:4:lhsmtool_posix.0 Request processed in 3308us (3845us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788846028.083983:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00002000:00100000:3.0:1788846028.084004:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff90e343bac000 x1875740683506688/t4294967321(0) o4->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:379/0 lens 504/448 e 0 to 0 dl 1788846039 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788846028.084014:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e343bac000 with x1875740683506688 ext(0->12) 00002000:00010000:3.0:1788846028.084021:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e343bac000 00000100:00100000:1.0:1788846028.085020:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6502:1875740702424064:192.168.203.20@tcp:105: 00010000:00010000:1.0:1788846028.085064:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846028.085136:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:2399:x1875740683506560:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 12709us (16820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.085148:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 103 00000100:00100000:0.0:1788846028.090887:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.090952:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683506816 00000100:00100000:3.0:1788846028.090976:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683506816 00000100:00100000:3.0:1788846028.091073:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 244 00000100:00100000:3.0:1788846028.091085:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+73:12453:x1875740683506816:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788846028.099920:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:3.0:1788846028.099937:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1788846028.099977:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788846028.100008:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e450e57780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788846028.100013:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d3a9900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e450e57900 00000020:00080000:3.0:1788846028.100016:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d3a9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e4500d4200 00000004:00080000:3.0:1788846028.100047:0:6495:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788846028.100068:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e4502fc6c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788846028.100070:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d1eb300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e4411ca300 00000020:00080000:3.0:1788846028.100072:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d1ebc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e475191e00 00000020:00080000:3.0:1788846028.100081:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788846028.100099:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788846028.100176:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788846028.100298:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+27:12453:x1875740683506816:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 9211us (9422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846028.100308:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 244 00010000:00010000:0.0:1788846028.100406:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100418:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100426:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100433:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846028.100437:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100445:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100459:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff90e461481100) 00010000:00010000:0.0:1788846028.100469:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846028.100474:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100481:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272660 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100508:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100515:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100563:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100568:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846028.100571:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100577:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100586:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff90e475235f00) 00010000:00010000:0.0:1788846028.100588:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846028.100591:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100598:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d56138272708 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100628:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100644:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100650:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100655:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42dc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846028.100659:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100666:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100675:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e3424a3100) 00010000:00010000:0.0:1788846028.100678:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846028.100680:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100686:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42dc00/0x21b4d56138272786 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100698:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100704:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100710:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100714:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846028.100724:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100731:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100752:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e3424a3100) 00010000:00010000:0.0:1788846028.100755:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846028.100758:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100764:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d561382727a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100782:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100788:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100794:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100800:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846028.100803:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100809:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100816:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:0.0:1788846028.100818:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846028.100827:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100833:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356800/0x21b4d5613827287b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100847:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100852:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100857:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100862:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846028.100864:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100870:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100878:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:0.0:1788846028.100880:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788846028.100884:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.100889:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d56138272938 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.101434:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846028.101454:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702424192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788846028.101512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846028.101641:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702424320:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788846028.101674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846028.101716:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846028.101723:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702424448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788846028.101755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846028.101815:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702424192 00000100:00100000:1.0:1788846028.101827:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702424192 00000100:00100000:1.0:1788846028.101897:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702424320 00000100:00100000:1.0:1788846028.101900:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702424320 00000100:00100000:1.0:1788846028.101913:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702424448 00000100:00100000:1.0:1788846028.101915:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702424448 00000100:00100000:1.0:1788846028.101931:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788846028.101942:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1875740702424192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788846028.101978:0:8906:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1788846028.102032:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f9fcb, atime: 0x6a9f9fcb, ctime: 0x6a9f9fcb, blocks: 0x8 00010000:00010000:1.0:1788846028.102041:0:8906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.102061:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1788846028.102067:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846028.102075:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.102095:0:8906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.102107:0:8906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.102207:0:8906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.102231:0:8906:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788846028.103619:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788846028.103642:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3640:x1875740702424320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788846028.103687:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1788846028.103712:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.103734:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.103744:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788846028.103748:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788846028.103753:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.103788:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.103803:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 12 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846028.103817:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1875740702424576:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846028.103922:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3410826c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846028.104731:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3642:x1875740702424192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2778us (3206us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788846028.104746:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788846028.104792:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788846028.104809:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3640:x1875740702424448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788846028.104970:0:8906:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788846028.104974:0:8906:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788846028 00002000:00010000:1.0:1788846028.104977:0:8906:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788846028.104979:0:8906:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788846028 -> 1788846028 00002000:00010000:1.0:1788846028.104982:0:8906:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788846028.105269:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3640:x1875740702424448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 467us (3510us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788846028.105277:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1788846028.105305:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846028.105328:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.105344:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846028.105350:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788846028.105376:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e343a39c00/2, rc 0, transno 4294967311 00010000:00010000:1.0:1788846028.105387:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.105393:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702424192:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788846028.105438:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.105447:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1936e76/0x21b4d56138272962 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.105476:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846028.105479:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846028.105486:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846028.105498:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.105551:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683506944 00000100:00100000:3.0:1788846028.105558:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683506944 00000100:00100000:3.0:1788846028.105605:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:3.0:1788846028.105614:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+13:2399:x1875740683506944:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788846028.107475:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1875740702424576:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846028.107894:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846028.108108:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000004:00080000:2.0:1788846028.108144:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e3445d7480/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788846028.108155:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702424448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788846028.108841:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683507072 00000100:00100000:1.0:1788846028.108852:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683507072 00010000:00010000:1.0:1788846028.108903:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 14 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846028.108955:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 104 00000100:00100000:1.0:1788846028.108968:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+14:2398:x1875740683507072:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846028.109000:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846028.109023:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 14 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.109039:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 14 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.109071:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fc8840d/0x21b4d56138272716 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754808 expref: 14 pid: 8433 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.109091:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846028.109097:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846028.109103:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.109115:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.109167:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:3.0:1788846028.109186:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1788846028.109200:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00010000:00010000:0.0:1788846028.109219:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.109245:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846028.109258:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683507072:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 287us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.109270:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 104 00010000:00010000:0.0:1788846028.109292:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.109303:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.109318:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683506944:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 3701us (3819us total) trans 0 rc 0/0 00010000:00010000:0.0:1788846028.109328:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788846028.109329:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 76 00000100:00100000:0.0:1788846028.109560:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875740702424320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5928us (7883us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788846028.109568:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1788846028.109591:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846028.109597:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.109602:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00010000:00010000:0.0:1788846028.109607:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc0e05350) 00000004:00080000:3.0:1788846028.109609:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00010000:00010000:0.0:1788846028.109613:0:7456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.109624:0:7456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788846028.109633:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e3445d7480, transno 4294967322 00010000:00010000:0.0:1788846028.109644:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.109653:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272969 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.109656:0:3640:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90e3445d5c00 x1875740702424320/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788846044 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788846028.109689:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e3445d5c00/2, rc 0, transno 4294967323 00010000:00010000:0.0:1788846028.109699:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846028.109701:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702424320:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788846028.109702:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846028.109704:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846028.120320:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846028.120423:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683507328 00000100:00100000:2.0:1788846028.120433:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683507328 00000100:00100000:2.0:1788846028.120485:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:2.0:1788846028.120494:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:12453:x1875740683507328:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788846028.120577:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846028.120602:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d5613827294d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548a2 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.120621:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:2.0:1788846028.120625:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846028.120653:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.120666:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.120675:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846028.120905:0:6516:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057a88455 reply state 00000000bd27f960 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.120918:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.120925:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:2.0:1788846028.120927:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846028.120930:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846028.121026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:12453:x1875740683507328:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 532us (713us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1788846028.121033:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 245 00000100:00100000:1.0:1788846028.123721:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.123860:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683507456 00000100:00100000:3.0:1788846028.123873:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683507456 00000100:00100000:3.0:1788846028.123945:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:3.0:1788846028.123958:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683507456:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788846028.124109:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788846028.124113:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788846028 -> 1788846027 00002000:00010000:3.0:1788846028.124116:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788846027 00002000:00010000:3.0:1788846028.124118:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788846028 -> 1788846027 00002000:00010000:3.0:1788846028.124120:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788846028.124189:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2399:x1875740683507456:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 234us (484us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788846028.124197:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 77 00000100:00100000:0.0:1788846028.127236:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.127368:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683507712 00000100:00100000:3.0:1788846028.127381:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683507712 00000100:00100000:3.0:1788846028.127462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:3.0:1788846028.127475:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:12453:x1875740683507712:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788846028.128824:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.128858:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 22 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.128870:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.128921:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 22 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.128967:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 22 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.128987:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702424704:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846028.130009:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846028.137917:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846028.138391:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683507840 00000100:00100000:1.0:1788846028.138405:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683507840 00010000:00010000:1.0:1788846028.138555:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 23 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846028.138781:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 105 00000100:00100000:0.0:1788846028.138796:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:2399:x1875740683507840:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846028.138815:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846028.138824:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 23 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.138839:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 23 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.138881:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:0.0:1788846028.138887:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.138898:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.138907:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.138931:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846028.139023:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:2399:x1875740683507840:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 231us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846028.139049:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 105 00010000:00010000:3.0:1788846028.140146:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138272931 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754894 expref: 22 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.140176:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702424704:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846028.140207:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140219:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140226:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140276:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140283:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140291:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140297:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846028.140319:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140330:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140346:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:3.0:1788846028.140350:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788846028.140355:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.140363:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272977 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.140455:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:12453:x1875740683507712:12345-192.168.203.20@tcp:55:lhsmtool_posix.0 Request processed in 12983us (13233us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788846028.140466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 246 00000100:00100000:3.0:1788846028.143713:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.143759:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.143796:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.143830:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.143866:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.143888:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.143926:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683508608 00000100:00100000:3.0:1788846028.143939:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683508608 00000100:00080000:3.0:1788846028.143980:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846028.144042:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683508224 00000100:00100000:3.0:1788846028.144046:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683508224 00000100:00080000:3.0:1788846028.144063:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846028.144085:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683508480 00000100:00100000:3.0:1788846028.144088:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683508480 00000100:00080000:3.0:1788846028.144129:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846028.144155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 308 00000100:00100000:3.0:1788846028.144167:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683508608:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846028.144261:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683508608:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 96us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846028.144270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 308 00000100:00100000:3.0:1788846028.144291:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 309 00000100:00100000:3.0:1788846028.144298:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683508224:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846028.144323:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2400:x1875740683508224:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846028.144329:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 309 00000100:00100000:3.0:1788846028.144341:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 310 00000100:00100000:3.0:1788846028.144347:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683508480:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846028.144370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2400:x1875740683508480:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846028.144377:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 310 00000100:00100000:1.0:1788846028.144474:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683507968 00000100:00100000:1.0:1788846028.144486:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683507968 00000100:00100000:1.0:1788846028.144556:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683508352 00000100:00100000:1.0:1788846028.144559:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683508352 00000100:00100000:1.0:1788846028.144591:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:1.0:1788846028.144599:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2400:x1875740683508352:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846028.144629:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2400:x1875740683508352:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.144636:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:1.0:1788846028.144649:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:1.0:1788846028.144656:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2399:x1875740683507968:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788846028.144696:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.144723:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.144734:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846028.144740:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788846028.144746:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.144790:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.144809:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 8 pid: 8430 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846028.144842:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875740702424832:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846028.144910:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450e57240 going to sleep for 11 seconds 00000100:00080000:1.0:1788846028.144928:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846028.145291:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683508096 00000100:00100000:2.0:1788846028.145298:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683508096 00000100:00100000:2.0:1788846028.145346:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 388 00000100:00100000:2.0:1788846028.145355:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683508096:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846028.145402:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b597c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2400:x1875740683508096:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 49us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846028.145410:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 388 00000100:00100000:0.0:1788846028.150101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846028.150183:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683508736 00000100:00100000:2.0:1788846028.150195:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683508736 00010000:00010000:2.0:1788846028.150247:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 9 pid: 8430 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.150292:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 106 00000100:00100000:2.0:1788846028.150304:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2399:x1875740683508736:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846028.150342:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846028.150370:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 9 pid: 8430 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.150386:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 9 pid: 8430 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.150420:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788846028.150426:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788846028.150432:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.150444:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.150468:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846028.150569:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+9:2399:x1875740683508736:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 267us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846028.150578:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 106 00010000:00010000:1.0:1788846028.150691:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d5613827295b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b0 expref: 8 pid: 8430 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846028.150709:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875740702424832:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846028.150734:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150745:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150753:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150775:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150784:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150793:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150814:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846028.150819:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150829:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150854:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.150863:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdd644e4/0x21b4d5613827297e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846028.150917:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683507968:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 6260us (7219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.150925:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 78 00000100:00100000:0.0:1788846028.154226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.154318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683508992 00000100:00100000:3.0:1788846028.154331:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683508992 00000100:00100000:3.0:1788846028.154412:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 247 00000100:00100000:3.0:1788846028.154433:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:12453:x1875740683508992:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788846028.154610:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.154632:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.154667:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.154713:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.154730:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 21 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.154747:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702424960:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846028.154897:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846028.158946:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846028.159413:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683509120 00000100:00100000:1.0:1788846028.159436:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683509120 00010000:00010000:1.0:1788846028.159489:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 22 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846028.159572:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 107 00000100:00100000:1.0:1788846028.159584:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:2399:x1875740683509120:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846028.159602:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846028.159629:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 22 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.159644:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 22 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.159674:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:1.0:1788846028.159680:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.159692:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.159701:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.159710:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.159734:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846028.159798:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:2399:x1875740683509120:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 216us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.159807:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 107 00010000:00010000:3.0:1788846028.161316:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272874 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175485c expref: 21 pid: 6515 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.161350:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702424960:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846028.161381:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.161645:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.161653:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.162153:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.162195:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.162205:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.162254:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.162273:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 21 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.162291:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702425088:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846028.162653:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d6bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846028.166439:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.166600:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683509248 00000100:00100000:3.0:1788846028.166612:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683509248 00010000:00010000:3.0:1788846028.166667:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 22 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.166717:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 108 00000100:00100000:3.0:1788846028.166729:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:2399:x1875740683509248:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846028.166748:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846028.166775:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 22 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.166790:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 22 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.166821:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:3.0:1788846028.166827:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.166838:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.166859:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.166882:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846028.166941:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:2399:x1875740683509248:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 215us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846028.166950:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 108 00010000:00010000:2.0:1788846028.168609:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d5613827293f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175489b expref: 21 pid: 6517 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.168647:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702425088:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846028.168679:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.168692:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.168697:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846028.169268:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788846028.170160:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788846028.170228:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788846028.170350:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875740702425216:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788846028.170457:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846028.170566:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469a70600 going to sleep for 11 seconds 00000100:00100000:3.0:1788846028.171068:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702425216 00000100:00100000:3.0:1788846028.171082:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702425216 00000100:00100000:3.0:1788846028.171196:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788846028.171209:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6517:x1875740702425216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788846028.171339:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6517:x1875740702425216:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846028.171347:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788846028.171436:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875740702425216:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788846028.171645:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1788846028.171716:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875740702425344:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788846028.171754:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846028.172295:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e44133a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846028.172380:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702425344 00000100:00100000:1.0:1788846028.172388:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702425344 00000100:00100000:2.0:1788846028.172638:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788846028.172647:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6517:x1875740702425344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788846028.172826:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6517:x1875740702425344:12345-0@lo:1000:mdt00_002.0 Request processed in 179us (1070us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788846028.172834:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788846028.173081:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875740702425344:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788846028.173141:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173171:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173181:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173189:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846028.173195:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173205:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173226:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:3.0:1788846028.173230:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846028.173236:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173243:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d5613827298c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173274:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173280:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173287:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173293:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846028.173301:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173308:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173317:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846028.173320:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788846028.173328:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173342:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173352:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.173390:0:6517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846028.173406:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702425472:192.168.203.20@tcp:105: 00000100:00100000:3.0:1788846028.173743:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846028.177512:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846028.177651:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683509376 00000100:00100000:2.0:1788846028.177662:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683509376 00000100:00100000:2.0:1788846028.177732:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1788846028.177743:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:12452:x1875740683509376:12345-192.168.203.20@tcp:49:lfs.0 00000100:00100000:2.0:1788846028.177909:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:12452:x1875740683509376:12345-192.168.203.20@tcp:49:lfs.0 Request processed in 167us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846028.177917:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:3.0:1788846028.180825:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875740702425472:192.168.203.20@tcp:105: 00010000:00010000:3.0:1788846028.180873:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.180886:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382728cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846028.181417:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.181505:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683509632 00000100:00100000:3.0:1788846028.181515:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683509632 00000100:00100000:3.0:1788846028.181606:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 248 00000100:00100000:3.0:1788846028.181616:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:12452:x1875740683509632:12345-192.168.203.20@tcp:58:lfs.0 00000040:00080000:3.0:1788846028.181839:0:7876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788846028.181931:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+25:12452:x1875740683509632:12345-192.168.203.20@tcp:58:lfs.0 Request processed in 315us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846028.181939:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 248 00010000:00010000:2.0:1788846028.182840:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.182865:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.182902:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.182915:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.182922:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.182930:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.182937:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846028.182942:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.182949:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183026:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:2.0:1788846028.183030:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846028.183037:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183043:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138272993 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183061:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183066:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183079:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183085:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846028.183088:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183094:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183103:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:2.0:1788846028.183105:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846028.183107:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.183113:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d56138272985 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.183349:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:12453:x1875740683508992:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 28916us (29134us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788846028.183359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 247 00000020:00080000:2.0:1788846028.183365:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788846028.186152:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788846028.186166:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846028.186201:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788846028.186209:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788846028.187611:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846028.187662:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683509888 00000100:00100000:0.0:1788846028.187676:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683509888 00000100:00100000:0.0:1788846028.187748:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:0.0:1788846028.187759:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+24:12453:x1875740683509888:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788846028.188136:0:6519:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788846028.188185:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:0.0:1788846028.188226:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188257:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188271:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188281:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188292:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188322:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188343:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788846028.188474:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+26:12453:x1875740683509888:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 714us (872us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788846028.188484:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000020:00080000:0.0:1788846028.188489:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788846028.188581:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846028.188589:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188597:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846028.188602:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188610:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188625:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:0.0:1788846028.188628:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788846028.188632:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188639:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356000/0x21b4d5613827299a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846028.188651:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846028.188652:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846028.188654:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846028.189546:0:13794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702425600:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788846028.189862:0:13794:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cf600 going to sleep for 11 seconds 00000100:00100000:2.0:1788846028.196079:0:13794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13794:1875740702425600:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788846028.196081:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846028.196369:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683510016 00000100:00100000:1.0:1788846028.196377:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683510016 00000100:00100000:1.0:1788846028.196434:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:1.0:1788846028.196443:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+26:12454:x1875740683510016:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788846028.196482:0:6516:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788846028.197639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+26:12454:x1875740683510016:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 1185us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.197653:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 249 00000100:00100000:0.0:1788846028.202028:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.202140:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683510272 00000100:00100000:3.0:1788846028.202152:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683510272 00000100:00100000:3.0:1788846028.202231:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:3.0:1788846028.202243:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+26:12454:x1875740683510272:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846028.202272:0:7876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846028.202298:0:7876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548b7 expref: -99 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.202437:0:7876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382729a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.202456:0:7876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382729a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.202470:0:7876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382729a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846028.202484:0:7876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788846028.202688:0:7876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b7 expref: 29 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.202735:0:7876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382729a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b7 expref: 28 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.202745:0:7876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846028.202748:0:7876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788846028.202753:0:7876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064800, rc 0) 00000100:00100000:3.0:1788846028.202845:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+28:12454:x1875740683510272:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 604us (834us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788846028.202854:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 250 00000100:00100000:0.0:1788846028.209851:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846028.209957:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683510528 00000100:00100000:2.0:1788846028.209985:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683510528 00000100:00100000:2.0:1788846028.210071:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 251 00000100:00100000:2.0:1788846028.210082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+28:12454:x1875740683510528:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788846028.210208:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210231:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210245:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210446:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210455:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210462:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210468:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846028.210473:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210481:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210496:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:2.0:1788846028.210499:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846028.210548:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.210556:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382729b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.210852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:12454:x1875740683510528:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 769us (1014us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788846028.210862:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 251 00000040:00080000:3.0:1788846028.210863:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788846028.210870:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846028.211447:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788846028.211459:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788846028.224794:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846028.224929:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846028.225034:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683510912 00000100:00100000:3.0:1788846028.225047:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683510912 00000100:00100000:3.0:1788846028.225128:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:3.0:1788846028.225141:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+29:12456:x1875740683510912:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846028.225175:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846028.225201:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548be expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225283:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225301:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225339:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225360:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225368:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225376:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225491:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225504:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 30 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225515:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.225569:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683510784 00000100:00100000:2.0:1788846028.225577:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683510784 00010000:00010000:3.0:1788846028.225589:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 31 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846028.225609:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 31 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.225618:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:2.0:1788846028.225629:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+31:12454:x1875740683510784:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788846028.225631:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702425728:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846028.225747:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541300 going to sleep for 11 seconds 00000100:00100000:2.0:1788846028.225844:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:12454:x1875740683510784:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 215us (1065us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788846028.225853:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1788846028.230123:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846028.230277:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683511168 00000100:00100000:2.0:1788846028.230289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683511168 00000100:00100000:2.0:1788846028.230362:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1788846028.230375:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:6167:x1875740683511168:12345-192.168.203.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788846028.230597:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875740702425728:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846028.230639:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.230705:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:6167:x1875740683511168:12345-192.168.203.20@tcp:35:ldlm_bl.0 Request processed in 332us (599us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788846028.230714:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:0.0:1788846028.241326:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846028.241448:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683511296 00000100:00100000:2.0:1788846028.241462:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683511296 00010000:00010000:2.0:1788846028.241517:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 33 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.241640:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 109 00000100:00100000:2.0:1788846028.241652:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:2399:x1875740683511296:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846028.241671:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846028.241678:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 33 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.241693:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 33 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.241721:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382728c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754878 expref: 33 pid: 7876 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.241741:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:2.0:1788846028.241746:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.241756:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.241765:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846028.241807:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788846028.241878:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846028.241883:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+32:2399:x1875740683511296:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 232us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846028.241896:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 109 00010000:00010000:1.0:1788846028.241908:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846028.241977:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788846028.241982:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846028.242018:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242040:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242050:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242063:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242070:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242076:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846028.242080:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242089:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242108:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:1.0:1788846028.242110:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846028.242114:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242120:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065400/0x21b4d561382729c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242141:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242147:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242153:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242158:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846028.242160:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242166:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242174:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff90e451770200) 00010000:00010000:1.0:1788846028.242177:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846028.242181:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242186:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064000/0x21b4d561382729cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242244:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548be expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242260:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548be expref: 31 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846028.242268:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:1.0:1788846028.242271:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846028.242274:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065e00, rc 0) 00000100:00100000:1.0:1788846028.242305:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+31:12456:x1875740683510912:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 17167us (17376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846028.242313:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 252 00000100:00100000:3.0:1788846028.601862:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702425856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846028.601938:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846028.602071:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846028.602284:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702425856 00000100:00100000:2.0:1788846028.602305:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702425856 00000100:00100000:2.0:1788846028.602360:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788846028.602369:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702425856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846028.602412:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788846028.604309:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702425856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1934us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846028.604322:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788846028.605045:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702425856:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1788846029.002032:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788846029.002047:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000040:00080000:3.0:1788846029.080326:0:14702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788846029.080335:0:14702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846029.080366:0:14702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788846029.080372:0:14702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788846029.286320:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846029.290334:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683511552 00000100:00100000:3.0:1788846029.290348:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683511552 00000100:00100000:3.0:1788846029.290424:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:3.0:1788846029.290436:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+31:12479:x1875740683511552:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846029.290458:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846029.290477:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382729d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548c5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.290597:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382729e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.290612:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382729e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.290627:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382729e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846029.290639:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788846029.290740:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065800/0x21b4d561382729d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548c5 expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.290767:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382729e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548c5 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.290776:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846029.290779:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788846029.290782:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065a00, rc 0) 00000100:00100000:3.0:1788846029.290847:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:12479:x1875740683511552:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 414us (4535us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788846029.290855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 253 00000100:00100000:3.0:1788846029.298072:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846029.298110:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683511680 00000100:00100000:3.0:1788846029.298119:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683511680 00000100:00100000:3.0:1788846029.298170:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:3.0:1788846029.298180:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:12479:x1875740683511680:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:3.0:1788846029.298244:0:12145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298261:0:12145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298272:0:12145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298306:0:12145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298313:0:12145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298333:0:12145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298340:0:12145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846029.298345:0:12145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298353:0:12145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298365:0:12145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:3.0:1788846029.298368:0:12145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788846029.298372:0:12145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846029.298379:0:12145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065200/0x21b4d561382729ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846029.298465:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:12479:x1875740683511680:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 287us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846029.298474:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 254 00000100:00100000:3.0:1788846029.462876:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846029.462960:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683511808 00000100:00100000:1.0:1788846029.462969:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683511808 00000100:00100000:1.0:1788846029.463105:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00100000:1.0:1788846029.463115:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2399:x1875740683511808:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:1.0:1788846029.463142:0:8906:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846029.463173:0:8906:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef35cc35/0x21b4d561382729f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548cc expref: -99 pid: 8906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788846029.463198:0:8906:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f9fcb, atime: 0x6a9f9fcb, ctime: 0x6a9f9fcb, blocks: 0x8 00010000:00010000:1.0:1788846029.464028:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1788846029.464049:0:8906:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846029.464060:0:8906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef35cc35/0x21b4d561382729f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548cc expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846029.464083:0:8906:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef35cc35/0x21b4d561382729f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548cc expref: 8 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846029.464098:0:8906:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3a00, rc 0) 00000100:00100000:1.0:1788846029.464608:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2399:x1875740683511808:12345-192.168.203.20@tcp:101:cat.0 Request processed in 1381us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846029.464617:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 79 00000100:00080000:3.0:1788846029.465078:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846029.472801:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846029.477802:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683511936 00000100:00100000:0.0:1788846029.477817:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683511936 00002000:00100000:0.0:1788846029.477876:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff90e344575500 x1875740683511936/t0(0) o3->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:380/0 lens 488/0 e 0 to 0 dl 1788846040 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788846029.477897:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e344575500 with x1875740683511936 ext(0->4095) 00002000:00010000:0.0:1788846029.477903:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e344575500 00000100:00100000:0.0:1788846029.477937:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1788846029.477947:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683511936:12345-192.168.203.20@tcp:3:cat.0 00000100:00100000:0.0:1788846029.478146:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683511936:12345-192.168.203.20@tcp:3:cat.0 Request processed in 199us (5352us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788846029.478154:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00002000:00100000:0.0:1788846029.478161:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff90e344575500 x1875740683511936/t0(0) o3->81c4acd6-5aaa-4daa-a0bb-a25a5f21f635@192.168.203.20@tcp:380/0 lens 488/4536 e 0 to 0 dl 1788846040 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788846029.478169:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90e344575500 with x1875740683511936 ext(0->4095) 00002000:00010000:0.0:1788846029.478173:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90e344575500 00010000:00010000:0.0:1788846029.625913:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846030.652039:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846031.164472:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702425984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846031.164496:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702426112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788846031.164594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846031.164880:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702426112 00000100:00100000:2.0:1788846031.164890:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702426112 00000100:00100000:2.0:1788846031.164985:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788846031.164996:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702426112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788846031.165033:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788846031.165064:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846031.165084:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702426112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846031.165091:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788846031.165107:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702425984 00000100:00100000:2.0:1788846031.165111:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702425984 00000100:00100000:2.0:1788846031.165133:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788846031.165141:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46e5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702425984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788846031.165152:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788846031.165188:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46e5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702425984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846031.165210:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788846031.165230:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788846031.165239:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1788846031.165290:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e3439d5180, transno 4294967308 00000004:00080000:1.0:1788846031.165303:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788846031.165318:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e343a39c00, transno 4294967311 00000100:00100000:1.0:1788846031.165332:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702425984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788846031.165510:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846031.165586:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702426112:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788846031.673840:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846031.674289:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788846031.674323:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702426368:0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.674416:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702426496:0@lo:400:kworker.0 00000100:00100000:2.0:1788846031.674431:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846031.674472:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846031.674552:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702427008:0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.674576:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846031.674598:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702427520:0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.674624:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846031.674650:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788846031.674656:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702426624:0@lo:400:kworker.0 00000100:00100000:3.0:1788846031.674665:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702426368 00000100:00100000:3.0:1788846031.674685:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702426368 00000100:00100000:1.0:1788846031.674702:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846031.674720:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702427136:0@lo:400:kworker.0 00000100:00100000:3.0:1788846031.674741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788846031.674741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846031.674757:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702427648:0@lo:400:kworker.0 00000100:00100000:3.0:1788846031.674759:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702426368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.674776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846031.674857:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702426880:0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.674898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846031.674923:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702426496 00000100:00100000:1.0:1788846031.674929:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702426496 00000100:00100000:1.0:1788846031.674961:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702427008 00000100:00100000:1.0:1788846031.674974:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702427008 00000100:00100000:1.0:1788846031.675007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702427136 00000100:00100000:1.0:1788846031.675009:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702427136 00000100:00100000:1.0:1788846031.675024:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788846031.675030:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702426496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675072:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702426496:12345-0@lo:400:kworker.0 Request processed in 41us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846031.675080:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788846031.675097:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788846031.675103:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702427008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675131:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702427008:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846031.675137:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788846031.675148:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788846031.675153:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702427136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675179:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702427136:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846031.675184:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788846031.675212:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702427520 00000100:00100000:1.0:1788846031.675215:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702427520 00000100:00100000:1.0:1788846031.675245:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702427648 00000100:00100000:1.0:1788846031.675248:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702427648 00000100:00100000:1.0:1788846031.675267:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788846031.675273:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702427520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675310:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702427520:12345-0@lo:400:kworker.0 Request processed in 36us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846031.675316:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788846031.675326:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788846031.675332:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875740702427648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675359:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875740702427648:12345-0@lo:400:kworker.0 Request processed in 27us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846031.675364:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:1.0:1788846031.675406:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e34443b480 x1875740702427136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846031.675421:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702427136:0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675434:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702427648:0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675444:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702426496:0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675453:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702427008:0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675461:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702427520:0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675511:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702426624 00000100:00100000:1.0:1788846031.675515:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702426624 00000100:00100000:1.0:1788846031.675564:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702426880 00000100:00100000:1.0:1788846031.675568:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702426880 00000100:00100000:1.0:1788846031.675591:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788846031.675597:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702426624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675642:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702426624:12345-0@lo:400:kworker.0 Request processed in 45us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846031.675648:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788846031.675660:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788846031.675665:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702426880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846031.675692:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702426880:12345-0@lo:400:kworker.0 Request processed in 27us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846031.675697:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788846031.675723:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702426624:0@lo:400:kworker.0 00000100:00080000:1.0:1788846031.675798:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846031.675803:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846031.675805:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846031.676703:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702426880:0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.676717:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702427392:0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.676765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846031.676798:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788846031.676806:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702426752:0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.676830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846031.676850:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702427264:0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.676872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846031.676904:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702427392 00000100:00100000:0.0:1788846031.676910:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702427392 00000100:00100000:0.0:1788846031.676963:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702426752 00000100:00100000:0.0:1788846031.676976:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702426752 00000100:00100000:0.0:1788846031.676994:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702427264 00000100:00100000:0.0:1788846031.676997:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702427264 00000100:00100000:0.0:1788846031.677029:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788846031.677037:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702427392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.677083:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702427392:12345-0@lo:400:kworker.0 Request processed in 47us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846031.677090:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788846031.677106:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788846031.677112:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.677138:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875740702426752:12345-0@lo:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846031.677144:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788846031.677153:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788846031.677173:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702427264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.677208:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702427264:12345-0@lo:400:kworker.0 Request processed in 36us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846031.677214:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00080000:0.0:1788846031.677236:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788846031.677239:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846031.677304:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702426752:0@lo:400:kworker.0 00000100:00100000:0.0:1788846031.677315:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702427264:0@lo:400:kworker.0 00010000:00080000:0.0:1788846031.677325:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e34443a300 x1875740702427392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846031.677334:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702427392:0@lo:400:kworker.0 00000100:00100000:3.0:1788846031.681289:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702426368:12345-0@lo:400:kworker.0 Request processed in 6513us (6839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846031.681309:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788846031.684146:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702426368:0@lo:400:kworker.0 00000100:00100000:2.0:1788846031.684169:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702426240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846031.684266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846031.685287:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702426240 00000100:00100000:1.0:1788846031.685314:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702426240 00000100:00100000:1.0:1788846031.685414:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788846031.685427:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702426240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846031.685476:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788846031.685592:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702426240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846031.685599:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788846031.686083:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702426240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846032.185785:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846032.185809:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702427776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846032.185882:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846032.185947:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702427776 00000100:00100000:1.0:1788846032.185955:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702427776 00000100:00100000:1.0:1788846032.186030:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788846032.186039:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702427776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788846032.186068:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788846032.186112:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702427776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846032.186119:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788846032.186172:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702427776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846032.190293:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702427904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846032.190359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846032.190470:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702427904 00000100:00100000:1.0:1788846032.190477:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702427904 00000100:00100000:1.0:1788846032.190559:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788846032.190568:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702427904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788846032.190589:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788846032.190630:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702427904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846032.190638:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788846032.190942:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702427904:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788846032.699282:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846033.274242:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846033.274293:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846033.274328:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846033.274361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846033.274390:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846033.274414:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846033.274442:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846033.274477:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683512576 00000100:00100000:1.0:1788846033.274487:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683512576 00000100:00100000:2.0:1788846033.274538:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683512064 00000100:00100000:2.0:1788846033.274545:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683512064 00000100:00100000:1.0:1788846033.274564:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683512448 00000100:00100000:1.0:1788846033.274570:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683512448 00000100:00100000:2.0:1788846033.274587:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 390 00000100:00100000:2.0:1788846033.274599:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683512064:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846033.274612:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1788846033.274637:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683512576:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846033.274667:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683512064:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 70us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846033.274675:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+8:2398:x1875740683512576:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846033.274678:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 390 00000100:00100000:1.0:1788846033.274689:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1788846033.274706:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:1.0:1788846033.274715:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683512448:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846033.274746:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683512448:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846033.274753:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 130 00000100:00100000:2.0:1788846033.274849:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683512320 00000100:00100000:2.0:1788846033.274853:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683512320 00000100:00100000:2.0:1788846033.275080:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683512832 00000100:00100000:2.0:1788846033.275084:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683512832 00000100:00100000:2.0:1788846033.275104:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683512192 00000100:00100000:2.0:1788846033.275108:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683512192 00000100:00100000:3.0:1788846033.275117:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683512704 00000100:00100000:3.0:1788846033.275123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683512704 00000100:00100000:2.0:1788846033.275128:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 317 00000100:00100000:2.0:1788846033.275137:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683512320:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846033.275158:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 318 00000100:00100000:3.0:1788846033.275168:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683512832:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846033.275176:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683512320:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 39us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846033.275193:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 317 00000100:00100000:3.0:1788846033.275211:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683512832:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 42us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846033.275211:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 319 00000100:00100000:2.0:1788846033.275220:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:2398:x1875740683512192:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846033.275223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 318 00000100:00100000:3.0:1788846033.275244:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 320 00000100:00100000:3.0:1788846033.275253:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683512704:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846033.275260:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+33:2398:x1875740683512192:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846033.275268:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 319 00000100:00100000:3.0:1788846033.275284:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683512704:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 32us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846033.275291:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 320 00000100:00080000:0.0:1788846033.275571:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788846033.275576:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788846033.275579:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788846033.275580:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788846033.721871:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846033.721894:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702428032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846033.721973:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846033.722033:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702428032 00000100:00100000:1.0:1788846033.722049:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702428032 00000100:00100000:1.0:1788846033.722101:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788846033.722111:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702428032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846033.722142:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788846033.722187:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702428032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846033.722193:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00010000:1.0:1788846033.722236:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846033.722259:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702428032:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1788846033.725674:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788846033.725688:0:9508:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788846033.728510:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788846033.728553:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90e341d6b480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788846033.728558:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d1eb100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90e45a021300 00000020:00080000:0.0:1788846033.728562:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90e47d1eb700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90e343939600 00000020:00080000:0.0:1788846033.728587:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1788846033.728778:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846033.728790:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846033.728797:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846033.728814:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846033.728818:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846033.728825:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846033.728841:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff90e3424a3000) 00010000:00010000:3.0:1788846033.728845:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846033.728850:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846033.728856:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d000/0x21b4d56138272970 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788846033.731829:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788846033.731908:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000040:00080000:0.0:1788846034.044637:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788846034.362707:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788846034.362720:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846034.362746:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788846034.362757:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788846034.747234:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846034.798660:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846034.801031:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683512960 00000100:00100000:2.0:1788846034.801052:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683512960 00000100:00100000:1.0:1788846034.803738:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00100000:1.0:1788846034.803767:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:12141:x1875740683512960:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788846034.804581:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:12141:x1875740683512960:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 810us (5939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846034.804595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 255 00000100:00100000:2.0:1788846034.809255:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846034.809639:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683513088 00000100:00100000:0.0:1788846034.809761:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683513088 00000100:00100000:0.0:1788846034.809845:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 256 00000100:00100000:0.0:1788846034.809859:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:12141:x1875740683513088:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788846034.810811:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:12141:x1875740683513088:12345-192.168.203.20@tcp:60:lhsmtool_posix.0 Request processed in 948us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846034.810824:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 256 00000100:00100000:0.0:1788846034.813841:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846034.814045:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683513344 00000100:00100000:3.0:1788846034.814059:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683513344 00000100:00100000:3.0:1788846034.814143:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:3.0:1788846034.814159:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:12141:x1875740683513344:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788846034.814491:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:12141:x1875740683513344:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 334us (657us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788846034.814500:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:3.0:1788846035.094470:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846035.094544:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683513472 00000100:00100000:0.0:1788846035.094566:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683513472 00000100:00100000:0.0:1788846035.094666:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 257 00000100:00100000:0.0:1788846035.094678:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:12937:x1875740683513472:12345-192.168.203.20@tcp:101:lsof.0 00010000:00010000:0.0:1788846035.094698:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846035.094717:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382729fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548d3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846035.094783:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272a03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846035.094798:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846035.094825:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846035.094872:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788846035.094876:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846035.094899:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846035.094938:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d561382729fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548d3 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846035.094969:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272a03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548d3 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846035.094978:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:0.0:1788846035.094981:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788846035.094985:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356a00, rc 0) 00000100:00100000:0.0:1788846035.095047:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:12937:x1875740683513472:12345-192.168.203.20@tcp:101:lsof.0 Request processed in 372us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846035.095058:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 257 00000100:00080000:2.0:1788846035.095636:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788846035.769690:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846036.282197:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846036.282219:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702428160:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846036.282288:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846036.283161:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702428288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846036.283215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846036.283290:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702428160 00000100:00100000:2.0:1788846036.283297:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702428160 00000100:00100000:2.0:1788846036.283345:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702428288 00000100:00100000:2.0:1788846036.283348:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702428288 00000100:00100000:2.0:1788846036.283363:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788846036.283370:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702428160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788846036.283396:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788846036.283455:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702428160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846036.283462:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788846036.283482:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788846036.283488:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702428288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788846036.283505:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788846036.283554:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702428288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846036.283561:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788846036.283603:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702428160:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788846036.283689:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846036.283711:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702428288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846036.793907:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702428672:0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.793989:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846036.794046:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702429184:0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.794074:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846036.794106:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702429696:0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.794132:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846036.794158:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788846036.794163:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702428544:0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.794184:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846036.794196:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702429056:0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.794214:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846036.794233:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702429568:0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.794251:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846036.794276:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702429184 00000100:00100000:1.0:1788846036.794283:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702429184 00000100:00100000:1.0:1788846036.794324:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702428544 00000100:00100000:1.0:1788846036.794327:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702428544 00000100:00100000:1.0:1788846036.794340:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702429056 00000100:00100000:1.0:1788846036.794342:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702429056 00000100:00100000:1.0:1788846036.794356:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788846036.794363:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702429184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.794426:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702429184:12345-0@lo:400:kworker.0 Request processed in 63us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846036.794434:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788846036.794448:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788846036.794454:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702428544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.794478:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702428544:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846036.794484:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788846036.794493:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788846036.794498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702429056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846036.794517:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702429056:12345-0@lo:400:kworker.0 Request processed in 20us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846036.794626:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702429696 00000100:00100000:3.0:1788846036.794631:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702429696 00000100:00100000:3.0:1788846036.794657:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702429568 00000100:00100000:3.0:1788846036.794660:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702429568 00000100:00100000:0.0:1788846036.794792:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702428672 00000100:00100000:0.0:1788846036.794797:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702428672 00000100:00100000:1.0:1788846036.794848:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788846036.797975:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788846036.798000:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702429696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846036.798098:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702429696:12345-0@lo:400:kworker.0 Request processed in 101us (3954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846036.798105:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788846036.798124:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788846036.798130:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702429568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846036.798345:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702429568:12345-0@lo:400:kworker.0 Request processed in 214us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846036.798352:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788846036.798381:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788846036.798386:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788846036.798389:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846036.798405:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702428800:0@lo:400:kworker.0 00000100:00100000:3.0:1788846036.798441:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846036.798462:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702429312:0@lo:400:kworker.0 00000100:00100000:3.0:1788846036.798483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846036.798507:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788846036.798513:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702428416:0@lo:400:kworker.0 00000100:00100000:3.0:1788846036.798660:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846036.798685:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702428928:0@lo:400:kworker.0 00000100:00100000:3.0:1788846036.798708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846036.800904:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702429440:0@lo:400:kworker.0 00000100:00100000:3.0:1788846036.800969:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846036.801004:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702428416 00000100:00100000:3.0:1788846036.801012:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702428416 00000100:00100000:3.0:1788846036.801062:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788846036.801070:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702428416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846036.801332:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702428416:12345-0@lo:400:kworker.0 Request processed in 262us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846036.801340:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788846036.801476:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788846036.801487:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702429824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846036.801516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846036.801568:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702428928 00000100:00100000:0.0:1788846036.801572:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702428928 00000100:00100000:0.0:1788846036.801597:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788846036.801604:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702428672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.801642:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702428672:12345-0@lo:400:kworker.0 Request processed in 39us (7654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846036.801649:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788846036.801661:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788846036.801667:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702428928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.801693:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702428928:12345-0@lo:400:kworker.0 Request processed in 26us (2984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846036.801714:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788846036.801731:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702428800 00000100:00100000:0.0:1788846036.801735:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702428800 00000100:00100000:0.0:1788846036.801765:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702429312 00000100:00100000:0.0:1788846036.801768:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702429312 00000100:00100000:0.0:1788846036.801793:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702429440 00000100:00100000:0.0:1788846036.801796:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702429440 00000100:00100000:0.0:1788846036.801944:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788846036.801951:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702428800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.801984:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702428800:12345-0@lo:400:kworker.0 Request processed in 34us (3542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846036.801990:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788846036.802002:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788846036.802008:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702429312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.802033:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702429312:12345-0@lo:400:kworker.0 Request processed in 25us (3549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846036.802038:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788846036.802048:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788846036.802053:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702429440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.802077:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702429440:12345-0@lo:400:kworker.0 Request processed in 24us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846036.802083:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788846036.802373:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702428544:0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.802386:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702429056:0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.802397:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702429568:0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.802417:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702428672:0@lo:400:kworker.0 00010000:00080000:0.0:1788846036.802433:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438eaa00 x1875740702429184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846036.802443:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702429184:0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.802452:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788846036.802456:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90e3445d5c00, transno 4294967323 00000004:00080000:0.0:1788846036.802468:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788846036.802486:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702429696:0@lo:400:kworker.0 00000100:00080000:0.0:1788846036.802741:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788846036.803919:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846036.803969:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702428416:0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.803985:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702428928:0@lo:400:kworker.0 00010000:00080000:0.0:1788846036.803998:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e8000 x1875740702429440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846036.804008:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702429440:0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.804020:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702428800:0@lo:400:kworker.0 00000100:00100000:0.0:1788846036.804032:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702429312:0@lo:400:kworker.0 00010000:00010000:1.0:1788846036.804987:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846036.814029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702429824 00000100:00100000:0.0:1788846036.814045:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702429824 00000100:00100000:0.0:1788846036.814692:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788846036.814706:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702429824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846036.814744:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788846036.814987:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702429824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 284us (13468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846036.814994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788846036.815096:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702429824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846037.305874:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788846037.305897:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702429952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846037.305976:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846037.306331:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702429952 00000100:00100000:1.0:1788846037.306339:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702429952 00000100:00100000:1.0:1788846037.306396:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788846037.306405:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702429952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788846037.306434:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788846037.306487:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702429952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846037.306493:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788846037.306638:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702429952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846037.307443:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846037.307458:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702430080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846037.307504:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846037.309308:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702430080 00000100:00100000:2.0:1788846037.309324:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702430080 00000100:00100000:2.0:1788846037.309387:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788846037.309397:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702430080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788846037.309420:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788846037.309504:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702430080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846037.309511:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788846037.310130:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702430080:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788846037.817741:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846038.385355:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846038.385391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846038.385409:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846038.385434:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846038.385452:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846038.385471:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846038.385497:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846038.385538:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683513984 00000100:00100000:3.0:1788846038.385548:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683513984 00000100:00100000:3.0:1788846038.385605:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683514112 00000100:00100000:3.0:1788846038.385609:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683514112 00000100:00100000:3.0:1788846038.385771:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:3.0:1788846038.385782:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683513984:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846038.385852:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683513984:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 73us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846038.385867:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:3.0:1788846038.385884:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:3.0:1788846038.385890:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683514112:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846038.385917:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2398:x1875740683514112:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846038.385934:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:3.0:1788846038.385954:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683513600 00000100:00100000:3.0:1788846038.385957:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683513600 00000100:00100000:3.0:1788846038.385981:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 392 00000100:00100000:3.0:1788846038.385986:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683513600:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846038.386084:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b593c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2398:x1875740683513600:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 95us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846038.386091:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 392 00000100:00080000:3.0:1788846038.386121:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788846038.386125:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846038.386902:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683513728 00000100:00100000:0.0:1788846038.386909:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683513728 00000100:00100000:0.0:1788846038.386961:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683514240 00000100:00100000:0.0:1788846038.386964:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683514240 00000100:00100000:0.0:1788846038.386978:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683513856 00000100:00100000:0.0:1788846038.386981:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683513856 00000100:00100000:0.0:1788846038.386993:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683514368 00000100:00100000:0.0:1788846038.386995:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683514368 00000100:00100000:0.0:1788846038.388748:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 327 00000100:00100000:0.0:1788846038.388770:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:2398:x1875740683513728:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846038.388858:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:2398:x1875740683513728:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 97us (3511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846038.388865:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 327 00000100:00100000:0.0:1788846038.388894:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 328 00000100:00100000:0.0:1788846038.388902:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2398:x1875740683514240:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846038.388940:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2398:x1875740683514240:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 40us (3530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846038.388947:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 328 00000100:00100000:0.0:1788846038.388968:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 329 00000100:00100000:0.0:1788846038.388975:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683513856:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846038.389002:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2398:x1875740683513856:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (3548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846038.389019:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 329 00000100:00100000:0.0:1788846038.389032:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 330 00000100:00100000:0.0:1788846038.389038:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683514368:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846038.389062:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2398:x1875740683514368:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 25us (3564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846038.389067:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 330 00000100:00080000:0.0:1788846038.389099:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788846038.389104:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788846038.643346:0:14900:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:40:37 (1788846037) 00010000:00010000:1.0:1788846038.843245:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846038.843659:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846038.843680:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702430208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846038.843745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846038.843833:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702430208 00000100:00100000:2.0:1788846038.843841:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702430208 00000100:00100000:2.0:1788846038.843897:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788846038.843908:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702430208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846038.843954:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788846038.844002:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702430208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846038.844021:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788846038.845419:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702430208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788846039.867591:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788846039.870793:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1788846039.870807:0:6495:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788846039.871037:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788846039.871048:0:6547:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788846040.890123:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846041.402073:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846041.402098:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702430336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788846041.402178:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846041.402548:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702430464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846041.402578:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846041.402932:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702430336 00000100:00100000:3.0:1788846041.402945:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702430336 00000100:00100000:3.0:1788846041.403141:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702430464 00000100:00100000:3.0:1788846041.403146:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702430464 00000100:00080000:0.0:1788846041.403227:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846041.407842:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788846041.408138:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702430336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788846041.408370:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788846041.408559:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788846041.408573:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702430464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788846041.408588:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788846041.408624:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702430336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 700us (6377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846041.408634:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788846041.408720:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702430464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846041.408748:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702430336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788846041.408829:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702430464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (6249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846041.408837:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788846041.913815:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702430592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846041.913906:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846041.914197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702430592 00000100:00100000:0.0:1788846041.914206:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702430592 00000100:00100000:0.0:1788846041.914259:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788846041.914269:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702430592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846041.914299:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788846041.914355:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702430592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846041.914362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788846041.914454:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702430592:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788846041.915038:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846041.915275:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702430848:0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846041.915370:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702431360:0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915392:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846041.915410:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702431872:0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846041.915452:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788846041.915457:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702430976:0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846041.915500:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702431488:0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915538:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846041.915571:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702430848 00000100:00100000:2.0:1788846041.915576:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702430848 00000100:00100000:2.0:1788846041.915608:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702431360 00000100:00100000:2.0:1788846041.915611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702431360 00000100:00100000:2.0:1788846041.915636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702430976 00000100:00100000:2.0:1788846041.915639:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702430976 00000100:00100000:2.0:1788846041.915669:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702431488 00000100:00100000:2.0:1788846041.915671:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702431488 00000100:00100000:2.0:1788846041.915687:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788846041.915693:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702430848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915735:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702430848:12345-0@lo:400:kworker.0 Request processed in 42us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846041.915743:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788846041.915761:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788846041.915768:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702431360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915794:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702431360:12345-0@lo:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846041.915800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788846041.915811:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788846041.915816:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702430976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915841:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702430976:12345-0@lo:400:kworker.0 Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846041.915847:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788846041.915859:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788846041.915865:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702431488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915891:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702431488:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846041.915906:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:2.0:1788846041.915928:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788846041.915931:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846041.915954:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702430976:0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915964:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702431488:0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.915983:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702430848:0@lo:400:kworker.0 00010000:00080000:2.0:1788846041.915995:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e9c00 x1875740702431360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846041.916005:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702431360:0@lo:400:kworker.0 00000100:00100000:3.0:1788846041.916223:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702431872 00000100:00100000:3.0:1788846041.916227:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702431872 00000100:00100000:3.0:1788846041.916274:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788846041.916281:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702431872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846041.916318:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702431872:12345-0@lo:400:kworker.0 Request processed in 38us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846041.916324:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788846041.916355:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702431104:0@lo:400:kworker.0 00000100:00100000:3.0:1788846041.916383:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846041.916400:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702431616:0@lo:400:kworker.0 00000100:00100000:3.0:1788846041.916419:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846041.916439:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788846041.916445:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702430720:0@lo:400:kworker.0 00000100:00100000:3.0:1788846041.916482:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846041.916504:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702431232:0@lo:400:kworker.0 00000100:00100000:3.0:1788846041.916562:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846041.916580:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702431744:0@lo:400:kworker.0 00000100:00100000:1.0:1788846041.916584:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702431104 00000100:00100000:1.0:1788846041.916590:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702431104 00000100:00100000:3.0:1788846041.916607:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846041.916627:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788846041.916637:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702431104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846041.916640:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702431744 00000100:00100000:3.0:1788846041.916646:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702431744 00000100:00100000:3.0:1788846041.916673:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788846041.916680:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702431744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846041.916714:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702431744:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846041.916721:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788846041.916761:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702431744:0@lo:400:kworker.0 00000100:00100000:1.0:1788846041.916865:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702431104:12345-0@lo:400:kworker.0 Request processed in 229us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846041.916873:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788846041.917314:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702431104:0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.917447:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702430720 00000100:00100000:2.0:1788846041.917453:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702430720 00000100:00100000:2.0:1788846041.917491:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788846041.917499:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702430720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.917582:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3642:x1875740702430720:12345-0@lo:400:kworker.0 Request processed in 84us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846041.917589:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788846041.917619:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702431616 00000100:00100000:2.0:1788846041.917623:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702431616 00000100:00100000:2.0:1788846041.917657:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702431232 00000100:00100000:2.0:1788846041.917660:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702431232 00000100:00100000:2.0:1788846041.917680:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788846041.917686:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846041.917711:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788846041.917716:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702431616:12345-0@lo:400:kworker.0 Request processed in 31us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846041.917720:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702431232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846041.917722:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:2.0:1788846041.917739:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788846041.917742:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788846041.917745:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846041.917753:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702431232:12345-0@lo:400:kworker.0 Request processed in 35us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846041.917766:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702431872:0@lo:400:kworker.0 00000100:00100000:0.0:1788846041.917767:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788846041.917792:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702430720:0@lo:400:kworker.0 00000100:00100000:0.0:1788846041.917803:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702431232:0@lo:400:kworker.0 00010000:00080000:0.0:1788846041.917814:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e8000 x1875740702431616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846041.917823:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702431616:0@lo:400:kworker.0 00000100:00100000:3.0:1788846042.222361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846042.222557:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683514624 00000100:00100000:0.0:1788846042.222567:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683514624 00000100:00100000:0.0:1788846042.222702:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:0.0:1788846042.222713:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+19:13160:x1875740683514624:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:0.0:1788846042.223098:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:13160:x1875740683514624:12345-192.168.203.20@tcp:35:umount.0 Request processed in 386us (744us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788846042.223106:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00080000:2.0:1788846042.227985:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846042.232717:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846042.232807:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683514880 00000100:00100000:3.0:1788846042.232818:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683514880 00000100:00100000:3.0:1788846042.232874:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:3.0:1788846042.232883:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+20:13160:x1875740683514880:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:3.0:1788846042.233187:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:13160:x1875740683514880:12345-192.168.203.20@tcp:35:umount.0 Request processed in 304us (477us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788846042.233196:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:3.0:1788846042.238747:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846042.238859:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683515136 00000100:00100000:0.0:1788846042.238878:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683515136 00000100:00100000:0.0:1788846042.238942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:0.0:1788846042.238952:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4800fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+21:13160:x1875740683515136:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:0.0:1788846042.239153:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4800fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:13160:x1875740683515136:12345-192.168.203.20@tcp:35:umount.0 Request processed in 201us (414us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788846042.239161:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:0.0:1788846042.242157:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846042.243959:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683515392 00000100:00100000:1.0:1788846042.243973:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683515392 00000100:00100000:1.0:1788846042.244125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:1.0:1788846042.244134:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+22:13160:x1875740683515392:12345-192.168.203.20@tcp:35:umount.0 00000100:00100000:1.0:1788846042.244508:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:13160:x1875740683515392:12345-192.168.203.20@tcp:35:umount.0 Request processed in 374us (2359us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788846042.244516:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:1.0:1788846042.250332:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846042.251578:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846042.255042:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846042.257492:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683515520 00000100:00100000:2.0:1788846042.257545:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683515520 00000100:00100000:0.0:1788846042.257847:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846042.257904:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683516160 00000100:00100000:0.0:1788846042.257908:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683516160 00000100:00100000:0.0:1788846042.257966:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 80 00000100:00100000:0.0:1788846042.257976:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2397:x1875740683516160:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:0.0:1788846042.258003:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271f67 00000020:00010000:0.0:1788846042.258010:0:8430:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e34440a800: total 0 00000100:00080000:0.0:1788846042.258014:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e344408800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788846042.258053:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788846042.258190:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2397:x1875740683516160:12345-192.168.203.20@tcp:9:umount.0 Request processed in 216us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846042.258198:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 80 00000020:00010000:0.0:1788846042.258224:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e34440a800: total 0 00010000:00010000:0.0:1788846042.258246:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e34440a800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788846042.258295:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272326 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546e9 expref: 4 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846042.258327:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef35cc35/0x21b4d561382729f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548cc expref: 3 pid: 8906 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846042.258341:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e34440a800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788846042.258352:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846042.258355:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846042.258356:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788846042.258364:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846042.263060:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683515648 00000100:00100000:2.0:1788846042.263074:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683515648 00000100:00100000:2.0:1788846042.263092:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683515776 00000100:00100000:2.0:1788846042.263094:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683515776 00000100:00100000:2.0:1788846042.263116:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1788846042.263125:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22bfafdd-07c8-48a2-8d88-9be191aa000d+15:2398:x1875740683515520:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846042.263140:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846042.263160:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2000/0x21b4d5613827195c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754426 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846042.263174:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846042.263235:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22bfafdd-07c8-48a2-8d88-9be191aa000d+14:2398:x1875740683515520:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 111us (12921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846042.263242:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:2.0:1788846042.263265:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1788846042.263270:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22bfafdd-07c8-48a2-8d88-9be191aa000d+13:2399:x1875740683515648:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846042.263277:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846042.263285:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d200/0x21b4d5613827191d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217543e7 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846042.263294:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846042.263310:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:2399:x1875740683515648:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 40us (11738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846042.263316:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1788846042.263342:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1788846042.263348:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:2399:x1875740683515776:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846042.263372:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846042.263381:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c200/0x21b4d56138271bf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544ff expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846042.263389:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846042.263406:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683515776:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 59us (8375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846042.263412:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846042.265678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846042.267131:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683516288 00000100:00100000:1.0:1788846042.267143:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683516288 00000100:00100000:1.0:1788846042.267215:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 81 00000100:00100000:1.0:1788846042.267225:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2397:x1875740683516288:12345-192.168.203.20@tcp:9:umount.0 00000020:00000080:1.0:1788846042.267279:0:8906:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271cf8 00000100:00080000:1.0:1788846042.267288:0:8906:0:(import.c:65:import_set_state_nolock()) ffff90e343be3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846042.267341:0:8906:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788846042.267547:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+2:2397:x1875740683516288:12345-192.168.203.20@tcp:9:umount.0 Request processed in 323us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846042.267554:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 81 00010000:00010000:3.0:1788846042.268036:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788846042.268487:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846042.284805:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846042.285079:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683517312 00000100:00100000:0.0:1788846042.285102:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683517312 00000100:00100000:0.0:1788846042.285166:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 258 00000100:00100000:0.0:1788846042.285175:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+23:2397:x1875740683517312:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:0.0:1788846042.285205:0:7876:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827192b 00000020:00010000:0.0:1788846042.285220:0:7876:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e34377c000: total 0 00000100:00080000:0.0:1788846042.285225:0:7876:0:(import.c:65:import_set_state_nolock()) ffff90e4752f9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788846042.285253:0:7876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:1.0:1788846042.285542:0:7456:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e34377c000: total 0 00010000:00010000:1.0:1788846042.285595:0:7456:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e34377c000, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1788846042.285629:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:1.0:1788846042.285633:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788846042.285641:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064800/0x21b4d561382729a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548b7 expref: 22 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285660:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:1.0:1788846042.285662:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788846042.285665:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065a00/0x21b4d561382729e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548c5 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285676:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:1.0:1788846042.285679:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788846042.285682:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065c00/0x21b4d56138271cce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754529 expref: 20 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285693:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e458422600) 00010000:00010000:1.0:1788846042.285695:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788846042.285699:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138271c57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175450d expref: 19 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285742:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:1.0:1788846042.285745:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788846042.285750:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356400/0x21b4d56138272698 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217547e5 expref: 18 pid: 7876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285762:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:1.0:1788846042.285764:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788846042.285768:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031e00/0x21b4d5613827238f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754705 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285781:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846042.285783:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846042.285787:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356e00/0x21b4d561382722e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546d4 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285797:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846042.285799:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788846042.285803:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031400/0x21b4d56138272311 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217546e2 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285814:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff90e451775900) 00010000:00010000:1.0:1788846042.285816:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788846042.285819:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031800/0x21b4d56138271fc9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754602 expref: 14 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.285833:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e458422400) 00010000:00010000:1.0:1788846042.285835:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846042.286016:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356c00/0x21b4d56138271c73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754514 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.286035:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:1.0:1788846042.286038:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788846042.286041:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475064400/0x21b4d561382728d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175487f expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.286052:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff90e4514bda00) 00010000:00010000:1.0:1788846042.286054:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846042.286058:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065e00/0x21b4d561382729d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548be expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.286071:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff90e4514bde00) 00010000:00010000:1.0:1788846042.286074:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788846042.286078:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e440031a00/0x21b4d561382723ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175470c expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.286096:0:7456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff90e461481500) 00010000:00010000:1.0:1788846042.286098:0:7456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788846042.286102:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e475065000/0x21b4d56138272207 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175469c expref: 9 pid: 12145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846042.286113:0:7456:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e34377c000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1788846042.286128:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846042.286130:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846042.286132:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846042.286702:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+7:2397:x1875740683517312:12345-192.168.203.20@tcp:39:umount.0 Request processed in 1524us (1902us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788846042.286712:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 258 00000100:00100000:3.0:1788846042.309305:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846042.309408:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683517440 00000100:00100000:2.0:1788846042.309419:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683517440 00000100:00100000:2.0:1788846042.309552:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 259 00000100:00100000:2.0:1788846042.309563:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+5:2397:x1875740683517440:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:2.0:1788846042.309607:0:6515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271932 00000100:00080000:2.0:1788846042.309624:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90e343669800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788846042.309653:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788846042.309676:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846042.309969:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:81c4acd6-5aaa-4daa-a0bb-a25a5f21f635+3:2397:x1875740683517440:12345-192.168.203.20@tcp:39:umount.0 Request processed in 407us (672us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788846042.309978:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 259 00000100:00080000:0.0:1788846042.310675:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846042.425841:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702432000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788846042.425916:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846042.427606:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846042.427639:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702432128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846042.427695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846042.440015:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702432000 00000100:00100000:3.0:1788846042.440031:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702432000 00000100:00100000:3.0:1788846042.440109:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702432128 00000100:00100000:3.0:1788846042.440113:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702432128 00000100:00100000:3.0:1788846042.440133:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788846042.440143:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702432000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846042.440173:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788846042.440332:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788846042.440343:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702432128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788846042.440354:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788846042.440399:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702432128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (12702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846042.440405:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788846042.440459:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702432128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846042.440636:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702432000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 494us (14720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846042.440643:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788846042.445302:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702432000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788846042.940168:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846043.505812:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846043.506201:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846043.506244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846043.506343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683517696 00000100:00100000:2.0:1788846043.506345:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683517824 00000100:00100000:2.0:1788846043.506352:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683517824 00000100:00100000:1.0:1788846043.506352:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683517696 00000100:00100000:0.0:1788846043.506421:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683517568 00000100:00100000:0.0:1788846043.506425:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683517568 00000100:00100000:0.0:1788846043.506470:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 394 00000100:00100000:0.0:1788846043.506479:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2401:x1875740683517568:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846043.506572:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2401:x1875740683517568:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 94us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846043.506579:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 394 00000100:00100000:1.0:1788846043.506914:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 337 00000100:00100000:1.0:1788846043.506923:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2401:x1875740683517696:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846043.506955:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2401:x1875740683517696:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 34us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846043.506962:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 337 00000100:00100000:2.0:1788846043.508112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 338 00000100:00100000:2.0:1788846043.508124:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683517824:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846043.508227:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2401:x1875740683517824:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 105us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846043.508234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 338 00000100:00080000:3.0:1788846043.512613:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788846043.512623:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788846043.961820:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846043.962215:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846043.963053:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702432256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846043.963129:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846043.964909:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702432256 00000100:00100000:2.0:1788846043.964924:0:7612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702432256 00000100:00100000:2.0:1788846043.965002:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788846043.965012:0:7612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702432256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846043.965052:0:7612:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788846043.965455:0:7612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702432256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 443us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846043.965463:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788846043.966302:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702432256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846044.123128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846044.123180:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846044.123217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846044.123701:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683517952 00000100:00100000:0.0:1788846044.123730:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683517952 00000100:00100000:0.0:1788846044.123792:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683518208 00000100:00100000:0.0:1788846044.123796:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683518208 00000100:00100000:0.0:1788846044.123810:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683518080 00000100:00100000:0.0:1788846044.123812:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683518080 00000100:00100000:0.0:1788846044.123829:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1788846044.123838:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+12:2399:x1875740683517952:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846044.125457:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846044.126390:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42ca00/0x21b4d56138271a2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175443b expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846044.126418:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846044.127290:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846044.127343:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683518464 00000100:00100000:3.0:1788846044.127352:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683518464 00000100:00100000:3.0:1788846044.127419:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 260 00000100:00100000:3.0:1788846044.127431:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+6:2397:x1875740683518464:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:3.0:1788846044.127471:0:12145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271a43 00000020:00010000:3.0:1788846044.127482:0:12145:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e342a20000: total 0 00000100:00080000:3.0:1788846044.127596:0:12145:0:(import.c:65:import_set_state_nolock()) ffff90e342a27800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788846044.127621:0:12145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:0.0:1788846044.127925:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+11:2399:x1875740683517952:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 4085us (4806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846044.127935:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1788846044.127958:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:0.0:1788846044.130741:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+10:2399:x1875740683518208:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846044.131180:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846044.131206:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441357000/0x21b4d56138271bee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217544f8 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846044.131223:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846044.131279:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+9:2399:x1875740683518208:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 3313us (8098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846044.131288:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:0.0:1788846044.131350:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:0.0:1788846044.131360:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+8:2399:x1875740683518080:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788846044.131384:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846044.131394:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c400/0x21b4d56138271a35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175446c expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846044.131403:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846044.131418:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22bfafdd-07c8-48a2-8d88-9be191aa000d+7:2399:x1875740683518080:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 62us (8202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846044.131424:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000020:00010000:1.0:1788846044.132600:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e342a20000: total 0 00010000:00010000:1.0:1788846044.132608:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846044.132659:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e342a20000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788846044.132693:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e3424a3a00) 00010000:00010000:1.0:1788846044.132698:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788846044.132706:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356a00/0x21b4d56138272a03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548d3 expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846044.132728:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e342a20000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788846044.132767:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846044.132769:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846044.132771:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846044.134051:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+3:2397:x1875740683518464:12345-192.168.203.20@tcp:39:umount.0 Request processed in 6610us (6752us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1788846044.134065:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 260 00000100:00100000:3.0:1788846044.145148:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846044.145305:0:7876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683518592 00000100:00100000:1.0:1788846044.145316:0:7876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683518592 00000100:00100000:1.0:1788846044.145379:0:7876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 261 00000100:00100000:1.0:1788846044.145389:0:7876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+5:2397:x1875740683518592:12345-192.168.203.20@tcp:39:umount.0 00000020:00000080:1.0:1788846044.145431:0:7876:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271a4a 00000100:00080000:1.0:1788846044.145443:0:7876:0:(import.c:65:import_set_state_nolock()) ffff90e342a25000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846044.145469:0:7876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788846044.145663:0:7876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d427c55d-013b-49aa-ae4d-d3c385e9b3d8+3:2397:x1875740683518592:12345-192.168.203.20@tcp:39:umount.0 Request processed in 274us (524us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788846044.145672:0:7876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 261 00010000:00010000:3.0:1788846044.146374:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846044.196412:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846044.196516:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683518848 00000100:00100000:3.0:1788846044.196560:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683518848 00000100:00100000:3.0:1788846044.196612:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 395 00000100:00100000:3.0:1788846044.196623:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+7:2397:x1875740683518848:12345-192.168.203.20@tcp:251:umount.0 00000020:00000080:3.0:1788846044.196672:0:6508:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271908 00000020:00010000:3.0:1788846044.196680:0:6508:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e343778800: total 0 00000100:00080000:3.0:1788846044.196685:0:6508:0:(import.c:65:import_set_state_nolock()) ffff90e34377a800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788846044.196774:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b590050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22bfafdd-07c8-48a2-8d88-9be191aa000d+3:2397:x1875740683518848:12345-192.168.203.20@tcp:251:umount.0 Request processed in 151us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846044.196782:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 395 00000020:00010000:1.0:1788846044.197307:0:7456:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e343778800: total 0 00010000:00010000:1.0:1788846044.197365:0:7456:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e343778800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788846044.197402:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2400/0x21b4d56138271963 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175442d expref: 2 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846044.197418:0:7456:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e343778800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788846044.197429:0:7456:0:(genops.c:885:class_export_put()) final put ffff90e343778800/22bfafdd-07c8-48a2-8d88-9be191aa000d 00010000:00010000:1.0:1788846044.197447:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846044.197450:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846044.197451:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788846044.199420:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e343778800/22bfafdd-07c8-48a2-8d88-9be191aa000d for MGS 00000020:00000080:3.0:1788846044.199478:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e34377a800 for MGS 00000040:00080000:0.0:1788846044.282654:0:13797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788846044.601772:0:13794:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788846044.601781:0:13794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788846044.602024:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788846044.602032:0:13794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788846044.985681:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.011937:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788846046.157473:0:15096:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788846046.165800:0:15096:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788846046.165874:0:15096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.165890:0:15096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.165904:0:15096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.165929:0:15096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.165955:0:15096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788846046.165961:0:15096:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788846046.165988:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846046.165992:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788846046.165998:0:15096:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788846046.166094:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e450dc1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788846046.166129:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702432384:0@lo:39:umount.0 00000100:00100000:3.0:1788846046.166198:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788846046.166302:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846046.166310:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846046.166318:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0ce00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846046.166322:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846046.166331:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846046.166338:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846046.166344:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846046.166347:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788846046.166350:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788846046.166379:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846046.166397:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846046.166425:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846046.166432:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0ce00/0x21b4d561382719be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719c5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846046.166446:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846046.166448:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846046.166450:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846046.166467:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702432384 00000100:00100000:0.0:1788846046.166474:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702432384 00000100:00100000:0.0:1788846046.166555:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788846046.166672:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702432512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846046.166706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846046.166766:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875740702432384:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788846046.166793:0:6515:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827151f 00000100:00080000:0.0:1788846046.166801:0:6515:0:(import.c:65:import_set_state_nolock()) ffff90e475022000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788846046.167190:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3639:x1875740702432384:12345-0@lo:39:umount.0 Request processed in 625us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846046.167199:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1788846046.167210:0:6515:0:(genops.c:885:class_export_put()) final put ffff90e475026000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1788846046.167245:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702432512 00000100:00100000:0.0:1788846046.167250:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702432512 00000100:00100000:0.0:1788846046.167286:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788846046.167293:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3640:x1875740702432512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788846046.167303:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846046.167317:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2200/0x21b4d561382719c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d561382719be expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846046.167342:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846046.167374:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:3640:x1875740702432512:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846046.167380:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:0.0:1788846046.167398:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e475026000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788846046.167441:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e475022000 for lustre-MDT0000 00000100:00100000:0.0:1788846046.167471:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702432512:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788846046.167503:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e450dc1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788846046.167513:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702432384:0@lo:39:umount.0 00010000:00010000:3.0:1788846046.167691:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846046.167702:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846046.167707:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788846046.167712:0:15096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788846046.170610:0:15096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170626:0:15096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170633:0:15096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170639:0:15096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170664:0:15096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846046.170678:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846046.170684:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170691:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846046.170694:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170703:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846046.170710:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846046.170715:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846046.170717:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788846046.170757:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170764:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846046.170790:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170797:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0d200/0x21b4d561382719cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170810:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.170811:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.170819:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.170830:0:15096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170838:0:15096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170844:0:15096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170849:0:15096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170862:0:15096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846046.170876:0:15096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170883:0:15096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170889:0:15096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170894:0:15096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170905:0:15096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788846046.170912:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846046.170917:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170932:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846046.170935:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170942:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846046.170947:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846046.170951:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846046.170953:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788846046.170955:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788846046.170972:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.170978:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846046.170998:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171005:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0c800/0x21b4d561382718c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382718c9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171016:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846046.171020:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171025:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42da00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846046.171028:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171041:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846046.171047:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846046.171052:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788846046.171054:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788846046.171056:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788846046.171073:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171078:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846046.171085:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171091:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138271c26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271c2d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171102:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.171105:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.171107:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.171117:0:15096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171123:0:15096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171128:0:15096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171144:0:15096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171155:0:15096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788846046.171158:0:15096:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788846046.171161:0:15096:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788846046.171193:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846046.171198:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171205:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441442000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846046.171208:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171215:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846046.171222:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846046.171227:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846046.171229:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788846046.171232:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788846046.171247:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171252:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846046.171259:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171274:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441442000/0x21b4d5613827147e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271485 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846046.171285:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.171287:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846046.171289:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788846046.171302:0:15096:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788846046.171307:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788846046.171312:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846046.171318:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788846046.171325:0:15096:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90e342935800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846046.171332:0:15096:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90e341e4d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846046.171338:0:15096:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90e46d52d800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846046.171343:0:15096:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90e4605fb000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788846046.171350:0:15096:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90e342a20000 d427c55d-013b-49aa-ae4d-d3c385e9b3d8 192.168.203.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846046.171355:0:15096:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90e34377c000 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 192.168.203.20@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:3.0:1788846046.171361:0:15096:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90e47b688000) has exports, disconnecting them 00000020:00080000:3.0:1788846046.171366:0:15096:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90e342935800), last request at 1788846041 00000020:00000080:3.0:1788846046.171374:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827183d 00000100:00080000:3.0:1788846046.171392:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e342937000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788846046.171438:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788846046.171450:0:15096:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e342935800): rc 0 00000020:00000080:3.0:1788846046.171453:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e342935800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788846046.171464:0:15096:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90e341e4d800), last request at 1788846041 00000020:00000080:3.0:1788846046.171468:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271709 00000100:00080000:3.0:1788846046.171480:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e341e4c800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788846046.171494:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788846046.171503:0:15096:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e341e4d800): rc 0 00000020:00000080:3.0:1788846046.171505:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e341e4d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788846046.171510:0:15096:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90e46d52d800), last request at 1788845826 00000020:00000080:3.0:1788846046.171514:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271606 00000100:00080000:3.0:1788846046.171546:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e46d528000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788846046.171559:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788846046.171566:0:15096:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e46d52d800): rc 0 00000020:00000080:3.0:1788846046.171569:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e46d52d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788846046.171575:0:15096:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90e4605fb000), last request at 1788845826 00000020:00000080:3.0:1788846046.171578:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382715c7 00000100:00080000:3.0:1788846046.171582:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e46d52b800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788846046.171594:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788846046.171600:0:15096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:3.0:1788846046.171664:0:15096:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e4605fb000): rc 0 00000004:00000080:3.0:1788846046.171670:0:15096:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1f08157bae0 00000100:00080000:3.0:1788846046.171686:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788846046.171689:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1788846046.172330:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702432896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846046.172401:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846046.172455:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846046.172462:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702432768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846046.172487:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846046.172543:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702432896 00000100:00100000:2.0:1788846046.172550:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702432896 00000100:00100000:2.0:1788846046.172608:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702432768 00000100:00100000:2.0:1788846046.172612:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702432768 00000100:00100000:2.0:1788846046.172630:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846046.172639:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+24:3643:x1875740702432896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846046.172651:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846046.172667:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441357c00/0x21b4d56138271c2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271c26 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846046.172680:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846046.172723:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+23:3643:x1875740702432896:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846046.172730:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846046.172747:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846046.172753:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:3643:x1875740702432768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846046.172760:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846046.172769:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7e00/0x21b4d561382718c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d561382718c2 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846046.172778:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846046.172798:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:3643:x1875740702432768:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846046.172803:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846046.172845:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702432768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846046.172857:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3643:1875740702432896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846046.175275:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846046.175305:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702432640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846046.175372:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846046.175414:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846046.175431:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702433024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846046.175457:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788846046.175506:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342935800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788846046.175579:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e341e4d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788846046.175604:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46d52d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:2.0:1788846046.175666:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702432640 00000100:00100000:2.0:1788846046.175678:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702432640 00000020:00000080:1.0:1788846046.175705:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342937000 for lustre-MDT0000 00000020:00000080:1.0:1788846046.175712:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e341e4c800 for lustre-MDT0000 00000020:00000080:1.0:1788846046.175716:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e46d528000 for lustre-MDT0000 00000100:00100000:2.0:1788846046.175738:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702433024 00000100:00100000:2.0:1788846046.175742:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702433024 00000100:00100000:2.0:1788846046.175761:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788846046.175768:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+22:3641:x1875740702432640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846046.175782:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846046.175800:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0de00/0x21b4d561382719d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d561382719cc expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846046.175816:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846046.175855:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+21:3641:x1875740702432640:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (483us total) trans 0 rc 0/0 00000100:00080000:1.0:1788846046.178554:0:15096:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788846046.178592:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e47d13f800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788846046.179171:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702433152:0@lo:39:umount.0 00000100:00100000:3.0:1788846046.179255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846046.179316:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702433152 00000100:00100000:3.0:1788846046.179323:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702433152 00000100:00100000:3.0:1788846046.179377:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788846046.179386:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875740702433152:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788846046.179417:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271668 00000100:00080000:3.0:1788846046.179427:0:6520:0:(import.c:65:import_set_state_nolock()) ffff90e46e348800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788846046.179447:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788846046.179642:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3639:x1875740702433152:12345-0@lo:39:umount.0 Request processed in 256us (386us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788846046.179650:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00010000:3.0:1788846046.179675:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846046.179706:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47d13f800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788846046.179713:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702433152:0@lo:39:umount.0 00000100:00080000:1.0:1788846046.179968:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788846046.179973:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788846046.180027:0:15096:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788846046.180092:0:15096:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788846046.180112:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e4437d5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788846046.180116:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788846046.180143:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788846046.180146:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788846046.180159:0:15096:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846046.180206:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788846046.180217:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+20:3641:x1875740702433024:12345-0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788846046.180218:0:15096:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788846046.180230:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e3438b2800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788846046.180236:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1788846046.180296:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90e47b688000) has no exports 00000100:00100000:0.0:1788846046.180315:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702433280:0@lo:9:umount.0 00000100:00100000:1.0:1788846046.180384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846046.180390:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4820ef800/0x21b4d56138271485 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d5613827147e expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846046.180408:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846046.180418:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702433408:0@lo:9:umount.0 00000100:00100000:2.0:1788846046.180450:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:3641:x1875740702433024:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (4991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846046.180455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846046.180463:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788846046.180501:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702433024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846046.180512:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702432640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846046.180566:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702433280 00000100:00100000:0.0:1788846046.180641:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702433280 00000100:00100000:0.0:1788846046.180683:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702433408 00000100:00100000:0.0:1788846046.180686:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702433408 00000100:00100000:0.0:1788846046.180706:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788846046.180713:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875740702433280:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788846046.180731:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382717b1 00000100:00080000:0.0:1788846046.180738:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e3424f3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788846046.181067:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788846046.181181:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3639:x1875740702433280:12345-0@lo:9:umount.0 Request processed in 468us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846046.181188:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788846046.181201:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788846046.181208:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1875740702433408:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788846046.181235:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382718f3 00000100:00080000:0.0:1788846046.181295:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e34377f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788846046.181321:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788846046.181392:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3639:x1875740702433408:12345-0@lo:9:umount.0 Request processed in 184us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846046.181398:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788846046.181423:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788846046.181445:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e4437d5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788846046.183739:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788846046.183748:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788846046.183756:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702433280:0@lo:9:umount.0 00000100:00080000:0.0:1788846046.183793:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e3438b2800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788846046.184294:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788846046.184300:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788846046.184309:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788846046.184747:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788846046.186514:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788846046.186547:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702433408:0@lo:9:umount.0 00000020:00080000:1.0:1788846046.198488:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90e47b688000) has no exports 00000020:00000080:1.0:1788846046.266144:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382714d9 00000020:00000080:1.0:1788846046.266163:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e458350800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788846046.266230:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788846046.266393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e458350800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788846046.266415:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846046.266425:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788846046.266429:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90e450c699b8) has no exports 00000020:00000080:0.0:1788846046.267192:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382714d2 00000020:00000080:0.0:1788846046.267201:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e4437d2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788846046.267267:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4437d2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788846046.267407:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846046.267417:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788846046.267420:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e4437d3800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788846046.267422:0:15096:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4437d3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788846046.267427:0:15096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1788846046.523648:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788846046.523673:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702433536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788846046.523756:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846046.524128:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702433536 00000100:00100000:2.0:1788846046.524138:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702433536 00000100:00100000:2.0:1788846046.524216:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788846046.524225:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702433536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788846046.524258:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788846046.524313:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702433536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846046.524320:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788846046.524371:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702433536:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788846046.524477:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788846047.033754:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846047.034421:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702433664:0@lo:400:kworker.0 00000100:00100000:3.0:1788846047.034551:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846047.034765:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702433664 00000100:00100000:1.0:1788846047.034775:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702433664 00000100:00100000:1.0:1788846047.034827:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788846047.034837:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:3642:x1875740702433664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846047.035472:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702433792:0@lo:400:kworker.0 00000100:00100000:2.0:1788846047.035516:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.035672:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702433920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846047.035700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.035731:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702433792 00000100:00100000:2.0:1788846047.035737:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702433792 00000100:00100000:2.0:1788846047.035763:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702433920 00000100:00100000:2.0:1788846047.035766:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702433920 00000100:00100000:2.0:1788846047.035776:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788846047.035782:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875740702433792:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788846047.035789:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788846047.036075:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1875740702433792:12345-0@lo:400:kworker.0 Request processed in 38us (304us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846047.036083:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788846047.036102:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788846047.036106:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875740702433920:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788846047.036111:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788846047.036142:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875740702433920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 34us (441us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846047.036148:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1788846047.036181:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788846047.036186:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e47b582000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788846047.036190:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788846047.039108:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47b592850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0315653-1ca9-40fd-86ef-b83b7b1cadfd+19:3642:x1875740702433664:12345-0@lo:400:kworker.0 Request processed in 4263us (4546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846047.039123:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:02020000:1.0:1788846047.039257:0:3640:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1788846047.039417:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702434048:0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.039480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.039506:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702434560:0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.039537:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.039554:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846047.039559:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702434432:0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.039580:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.040146:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702434048 00000100:00100000:0.0:1788846047.040156:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702434048 00000100:00100000:0.0:1788846047.040192:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702434560 00000100:00100000:0.0:1788846047.040194:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702434560 00000100:00100000:0.0:1788846047.040208:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788846047.040215:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1875740702434048:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788846047.040223:0:12145:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788846047.040265:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1875740702434048:12345-0@lo:400:kworker.0 Request processed in 50us (784us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788846047.040271:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788846047.040286:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788846047.040290:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1875740702434560:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788846047.040295:0:12145:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788846047.040317:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1875740702434560:12345-0@lo:400:kworker.0 Request processed in 26us (779us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788846047.040323:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788846047.040349:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702434432 00000100:00100000:0.0:1788846047.040353:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702434432 00000100:00100000:0.0:1788846047.040380:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788846047.040386:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702434432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.040444:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702434432:12345-0@lo:400:kworker.0 Request processed in 58us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.040463:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788846047.040510:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702434432:0@lo:400:kworker.0 00000100:00080000:0.0:1788846047.040542:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788846047.040547:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90e46e34a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788846047.040551:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788846047.040556:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90e46e34a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846047.040559:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 210 00000100:00080000:0.0:1788846047.040564:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90e46e34a000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846047.040887:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b1500 x1875740702434944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846047.040914:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875740702434048:0@lo:400:kworker.0 00000100:00080000:0.0:1788846047.040930:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788846047.040935:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90e342a21800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788846047.040938:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788846047.040941:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90e342a21800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846047.040944:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 246 00000100:00080000:0.0:1788846047.040949:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e342a21800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846047.040963:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b3b80 x1875740702435072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846047.040972:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702434560:0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.041005:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702434944:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788846047.041048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.041070:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702435072:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788846047.041088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.041112:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702434944 00000100:00100000:0.0:1788846047.041116:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702434944 00000100:00100000:0.0:1788846047.041135:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702435072 00000100:00100000:0.0:1788846047.041137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702435072 00000100:00100000:0.0:1788846047.041148:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788846047.041152:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702434944:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788846047.041166:0:6515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788846047.041210:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702434944:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 55us (161us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846047.041216:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788846047.041228:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788846047.041233:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702435072:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788846047.041239:0:6515:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788846047.041261:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702435072:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 27us (172us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846047.041267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1788846047.041293:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e46e34a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846047.041298:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846047.041301:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702434944:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788846047.041308:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e342a21800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846047.041311:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846047.041314:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702435072:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788846047.047203:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702433664:0@lo:400:kworker.0 00000100:00100000:3.0:1788846047.047240:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702434176:0@lo:400:kworker.0 00000100:00100000:3.0:1788846047.047302:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846047.047327:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702434688:0@lo:400:kworker.0 00000100:00100000:3.0:1788846047.047345:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846047.047366:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788846047.047371:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702434304:0@lo:400:kworker.0 00000100:00100000:3.0:1788846047.047388:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846047.047425:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702434816:0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.047660:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702434176 00000100:00100000:0.0:1788846047.047681:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702434176 00000100:00100000:0.0:1788846047.047715:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702434688 00000100:00100000:0.0:1788846047.047717:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702434688 00000100:00100000:0.0:1788846047.047851:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702434304 00000100:00100000:0.0:1788846047.047855:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702434304 00000100:00100000:0.0:1788846047.047883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788846047.047891:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702434688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.047939:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702434688:12345-0@lo:400:kworker.0 Request processed in 49us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.047946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788846047.047960:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788846047.047965:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702434304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.047985:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702434304:12345-0@lo:400:kworker.0 Request processed in 20us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.047990:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788846047.047998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788846047.048001:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875740702434176:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788846047.048007:0:6516:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788846047.048023:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3642:x1875740702434176:12345-0@lo:400:kworker.0 Request processed in 21us (721us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788846047.048028:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788846047.048074:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846047.048158:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788846047.048180:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788846047.048185:0:3642:0:(import.c:65:import_set_state_nolock()) ffff90e3424f2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788846047.048194:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788846047.048200:0:3642:0:(import.c:65:import_set_state_nolock()) ffff90e3424f2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846047.048204:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 228 00000100:00080000:3.0:1788846047.048210:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90e3424f2800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846047.048235:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ec000 x1875740702435200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846047.048254:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702434176:0@lo:400:kworker.0 00010000:00080000:3.0:1788846047.048266:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b0e00 x1875740702434688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846047.048275:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702434688:0@lo:400:kworker.0 00010000:00080000:3.0:1788846047.048293:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e9c00 x1875740702434304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846047.048301:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702434304:0@lo:400:kworker.0 00000100:00100000:3.0:1788846047.048316:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702435200:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788846047.048337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846047.048358:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702435200 00000100:00100000:3.0:1788846047.048361:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702435200 00000100:00100000:3.0:1788846047.048376:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788846047.048380:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702435200:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788846047.048392:0:6516:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788846047.048591:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702435200:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 46us (89us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788846047.048600:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788846047.048687:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e3424f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846047.048697:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788846047.048701:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702435200:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788846047.048959:0:8906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702434816 00000100:00100000:0.0:1788846047.048964:0:8906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702434816 00000100:00100000:0.0:1788846047.049015:0:8906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788846047.049022:0:8906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702434816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846047.049063:0:8906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702434816:12345-0@lo:400:kworker.0 Request processed in 43us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.049078:0:8906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788846047.049136:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846047.049159:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702434816:0@lo:400:kworker.0 00000100:00080000:2.0:1788846047.050045:0:3643:0:(import.c:65:import_set_state_nolock()) ffff90e47b582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846047.050052:0:3643:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 210 00000100:00080000:2.0:1788846047.050059:0:3643:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90e47b582000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846047.050090:0:3643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e343a39c00 x1875740702435328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846047.050132:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702433792:0@lo:400:kworker.0 00000100:00100000:3.0:1788846047.051768:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702435328:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788846047.051878:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846047.052939:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702435328 00000100:00100000:2.0:1788846047.052951:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702435328 00000100:00100000:2.0:1788846047.053009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788846047.053016:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44981b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702435328:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788846047.053037:0:6520:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788846047.053123:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44981b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702435328:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 106us (1243us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788846047.053131:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:0.0:1788846047.055379:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47b582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846047.055391:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846047.055396:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702435328:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788846047.074274:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788846047.074305:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff90e47b582000 already not connected (conn 2, was 1): DISCONN 00000100:00100000:3.0:1788846047.545821:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702435456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846047.545903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846047.546333:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702435456 00000100:00100000:0.0:1788846047.546342:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702435456 00000100:00100000:0.0:1788846047.546402:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788846047.546421:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702435456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788846047.546462:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788846047.550589:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702435456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4160us (4676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846047.550603:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788846047.550720:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702435456:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788846048.059137:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788846048.060571:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788846048.060594:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788846048.060600:0:7446:0:(genops.c:885:class_export_put()) final put ffff90e46d52a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788846048.060621:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000001:00080000:2.0:1788846048.060629:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788846048.060632:0:7446:0:(genops.c:885:class_export_put()) final put ffff90e342a25800/d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000001:00100000:2.0:1788846048.060637:0:7446:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000001:00080000:2.0:1788846048.060642:0:7446:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788846048.060644:0:7446:0:(genops.c:885:class_export_put()) final put ffff90e34366d800/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:0.0:1788846048.060762:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46d52a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788846048.060834:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342a25800/d427c55d-013b-49aa-ae4d-d3c385e9b3d8 for lustre-MDT0001 00000020:00000080:0.0:1788846048.060872:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34366d800/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 for lustre-MDT0001 00000020:00000080:0.0:1788846048.060913:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e46e348800 for lustre-MDT0001 00000020:00000080:0.0:1788846048.060919:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342a25000 for lustre-MDT0001 00000020:00000080:0.0:1788846048.060922:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e343669800 for lustre-MDT0001 00000001:00100000:1.0:1788846048.068679:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788846048.068691:0:8426:0:(genops.c:885:class_export_put()) final put ffff90e3424f6000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788846048.068729:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:1.0:1788846048.068732:0:8426:0:(genops.c:885:class_export_put()) final put ffff90e343be6800/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:0.0:1788846048.068863:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e3424f6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788846048.068923:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e343be6800/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 for lustre-OST0000 00000020:00000080:0.0:1788846048.068951:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e3424f3000 for lustre-OST0000 00000020:00000080:0.0:1788846048.068957:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e343be3800 for lustre-OST0000 00000001:00100000:1.0:1788846048.069886:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788846048.069893:0:6495:0:(genops.c:885:class_export_put()) final put ffff90e4605fb000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788846048.070122:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000001:00080000:1.0:1788846048.070132:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1788846048.070136:0:6495:0:(genops.c:885:class_export_put()) final put ffff90e342a20000/d427c55d-013b-49aa-ae4d-d3c385e9b3d8 00000001:00100000:3.0:1788846048.070206:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788846048.070210:0:9508:0:(genops.c:885:class_export_put()) final put ffff90e343779800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788846048.073018:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4605fb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788846048.073100:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e46d52b800 for lustre-MDT0000 00000001:00100000:1.0:1788846048.075469:0:6495:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000001:00080000:1.0:1788846048.075482:0:6495:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788846048.075498:0:6495:0:(genops.c:885:class_export_put()) final put ffff90e34377c000/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:2.0:1788846048.075614:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342a20000/d427c55d-013b-49aa-ae4d-d3c385e9b3d8 for lustre-MDT0000 00000020:00000080:2.0:1788846048.075682:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34377c000/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 for lustre-MDT0000 00000020:00000080:2.0:1788846048.075713:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342a27800 for lustre-MDT0000 00000020:00000080:2.0:1788846048.075718:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e4752f9800 for lustre-MDT0000 00000001:00100000:3.0:1788846048.076017:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:3.0:1788846048.076023:0:9508:0:(genops.c:885:class_export_put()) final put ffff90e34440a800/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 00000020:00000080:0.0:1788846048.076093:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e343779800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788846048.076137:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34440a800/81c4acd6-5aaa-4daa-a0bb-a25a5f21f635 for lustre-OST0001 00000020:00000080:0.0:1788846048.076153:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e34377f800 for lustre-OST0001 00000020:00000080:0.0:1788846048.076158:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e344408800 for lustre-OST0001 00000020:01000000:1.0:1788846048.314010:0:15096:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e342423420 - data ffff90e342049bd0/ffff90e475221800 00000020:01000000:1.0:1788846048.314175:0:15096:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e450c48900 - data ffff90e478985af8/ffff90e475211000 00000001:00000004:1.0:1788846048.325090:0:15096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:0.0:1788846048.404195:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788846048.404208:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788846048.404227:0:15096:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90e3445d5f80 x1875740702433152/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788846056 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846048.404258:0:15096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788846048.409251:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788846048.409260:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788846048.409284:0:15096:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788846048.409287:0:15096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788846048.409819:0:8900:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788846048.409831:0:8900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788846048.409841:0:8900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788846048.410984:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788846048.410990:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788846048.411011:0:15096:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788846048.411014:0:15096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788846048.411408:0:9822:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788846048.411412:0:9822:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788846048.411422:0:9822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788846048.413361:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382714a1 00000020:00000080:0.0:1788846048.413373:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e446a90800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788846048.418546:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446a90800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788846048.420970:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382714b6 00000020:00000080:0.0:1788846048.420985:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e458355000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788846048.421006:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788846048.421012:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846048.421020:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788846048.421025:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90e47b6899b8) has no exports 00000004:01000000:0.0:1788846048.421199:0:15096:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788846048.421208:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382718ec 00000020:00000080:0.0:1788846048.421213:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e34377e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788846048.421217:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788846048.421220:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846048.421228:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788846048.421230:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff90e3438799b8) has no exports 00000020:00000080:0.0:1788846048.421248:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382718e5 00000020:00000080:0.0:1788846048.421252:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e3438b7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788846048.421502:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e458355000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788846048.421511:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34377e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788846048.421515:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e3438b7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788846048.421858:0:15096:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788846048.421862:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788846048.421867:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788846048.421872:0:15096:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788846048.421875:0:15096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788846048.421947:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846048.421958:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788846048.421964:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382717aa 00000020:00000080:0.0:1788846048.421970:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e47f42a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788846048.424742:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e3438b2800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788846048.424760:0:38:0:(genops.c:885:class_export_put()) final put ffff90e34366a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788846048.424763:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34366a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788846048.424771:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788846048.424968:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788846048.425071:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47f42a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788846048.425087:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846048.425102:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788846048.425107:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff90e4752eb370) has no exports 00000020:00000080:3.0:1788846048.425117:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382717a3 00000020:00000080:3.0:1788846048.425124:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e46e34c800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788846048.426115:0:15096:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788846048.426123:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788846048.426127:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788846048.426134:0:15096:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788846048.426148:0:15096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788846048.426549:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e34c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788846048.426794:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846048.426806:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788846048.426830:0:15096:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788846048.426841:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827165a 00000020:00000080:3.0:1788846048.426858:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e47d304800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788846048.426864:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788846048.426868:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846048.426874:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788846048.426877:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90e450c68000) has no exports 00000020:00000080:3.0:1788846048.426882:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271653 00000020:00000080:3.0:1788846048.426886:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e47d13c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788846048.427494:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e4437d5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788846048.427503:0:38:0:(genops.c:885:class_export_put()) final put ffff90e47d36b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788846048.427506:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788846048.427511:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788846048.427617:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d304800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788846048.427622:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d13c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788846048.431577:0:15096:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788846048.431587:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788846048.431592:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788846048.431611:0:15096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788846048.431676:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846048.431691:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846048.431728:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846048.431731:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846048.431738:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e446a90000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788846048.431742:0:15096:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446a90000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788846048.431751:0:15096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788846048.431879:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382714bd 00000020:00000080:2.0:1788846048.431887:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e458351000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788846048.431892:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788846048.431897:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846048.431902:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788846048.431907:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90e47b68cd28) has no exports 00000020:00000080:2.0:1788846048.431934:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846048.431939:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788846048.431943:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382714c4 00000020:00000080:2.0:1788846048.431946:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e458353000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788846048.431955:0:15096:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e451417000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788846048.431971:0:15096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e451417000 3 00000020:01000004:2.0:1788846048.431974:0:15096:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e451417000 from lustre-MDT0000 00000020:00000080:2.0:1788846048.431997:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846048.432001:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788846048.432004:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e446a92800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788846048.432006:0:15096:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446a92800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788846048.432012:0:15096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788846048.432041:0:15096:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788846048.432046:0:15096:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788846048.432049:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788846048.432052:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846048.432054:0:15096:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846048.432061:0:15096:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90e4464c0000 a0315653-1ca9-40fd-86ef-b83b7b1cadfd 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846048.432066:0:15096:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90e47b68b370) has exports, disconnecting them 00000020:00080000:2.0:1788846048.432070:0:15096:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90e4464c0000), last request at 1788845809 00000020:00000080:2.0:1788846048.432087:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271462 00000020:00010000:2.0:1788846048.432091:0:15096:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90e4464c0000: total 2 00000100:00080000:2.0:1788846048.432095:0:15096:0:(import.c:65:import_set_state_nolock()) ffff90e4464c2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788846048.432112:0:15096:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e4464c0000): rc 0 00000020:00080000:2.0:1788846048.432116:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90e47b68b370) has no exports 00000100:00100000:0.0:1788846048.432311:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90e48034ce00:6511] 2 exiting: rc = 0 00000020:00000080:0.0:1788846048.432421:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47d13f800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788846048.432430:0:38:0:(genops.c:885:class_export_put()) final put ffff90e47d139000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788846048.432432:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d139000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788846048.432436:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788846048.432515:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e458351000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788846048.432535:0:38:0:(genops.c:885:class_export_put()) final put ffff90e458351800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788846048.432537:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e458351800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788846048.432540:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788846048.432566:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e458353000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788846048.434603:0:6504:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90e4464c0000: total 0 00010000:00010000:2.0:1788846048.434687:0:6504:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90e4464c0000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788846048.434726:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441357800/0x21b4d56138271c03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271bfc expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434746:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c600/0x21b4d56138271c11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271c0a expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434758:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064e00/0x21b4d5613827197f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271978 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434788:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42ce00/0x21b4d561382719e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d561382719da expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434797:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064a00/0x21b4d56138271971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d5613827196a expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434806:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064c00/0x21b4d56138271c1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271c18 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434831:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7000/0x21b4d56138271883 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d5613827187c expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434844:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064200/0x21b4d5613827198d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271986 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434861:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42de00/0x21b4d5613827199b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271994 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434871:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2600/0x21b4d561382719a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d561382719a2 expref: 5 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434881:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e6200/0x21b4d5613827155e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271557 expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434891:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0c600/0x21b4d561382719b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d561382719b0 expref: 3 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434903:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e4536e7400/0x21b4d5613827156c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x21b4d56138271565 expref: 2 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846048.434929:0:6504:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90e4464c0000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788846048.434943:0:6504:0:(genops.c:885:class_export_put()) final put ffff90e4464c0000/a0315653-1ca9-40fd-86ef-b83b7b1cadfd 00010000:00010000:2.0:1788846048.434964:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846048.434966:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846048.434968:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788846048.434984:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4464c0000/a0315653-1ca9-40fd-86ef-b83b7b1cadfd for MGS 00000020:00000080:0.0:1788846048.435027:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e4464c2000 for MGS 00000100:00100000:0.0:1788846048.435689:0:6509:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90e47b636200:6509] 1 exiting: rc = 0 00000100:00100000:0.0:1788846048.438730:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90e469b52000:6508] 0 exiting: rc = 1 00000100:00100000:2.0:1788846048.439397:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440045:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440055:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440061:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440067:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440072:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440077:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440082:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440088:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440093:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440100:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440107:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440113:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440119:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440126:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440131:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440137:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440142:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440148:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440153:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440158:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440164:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440173:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440178:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440186:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440190:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440195:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440222:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440227:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440234:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440239:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440244:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440249:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440254:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440259:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440263:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440268:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440273:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440277:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440281:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440286:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440291:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440297:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440302:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440307:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440311:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440316:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440321:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440326:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440331:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440336:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440341:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440346:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440351:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440356:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440361:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440365:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440370:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440376:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440383:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440388:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.440394:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.446952:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846048.446963:0:15096:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788846048.452512:0:15096:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e3424236c0 - data ffff90e342078288/ffff90e342aafc00 00000020:01000000:2.0:1788846048.452707:0:15096:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e446636ea0 - data ffff90e478814438/ffff90e47b595c00 00000020:00000080:2.0:1788846048.453177:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271446 00000020:00000080:2.0:1788846048.453185:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e4464c5800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788846048.453201:0:15096:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e451417000 from MGS, refs=2 00000020:00000080:0.0:1788846048.453242:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4464c5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788846048.453491:0:15096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e451417000 2 00000020:01000004:2.0:1788846048.453496:0:15096:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e451417000 from MGS 00000020:00000080:2.0:1788846048.453542:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846048.453550:0:15096:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788846048.453557:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e4464c3800/MGS 00000020:00000080:2.0:1788846048.453560:0:15096:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4464c3800/MGS for MGS 00000020:01000000:2.0:1788846048.453566:0:15096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788846048.453817:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788846048.453821:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846048.453828:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788846048.453834:0:15096:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90e47518a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788846048.453839:0:15096:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff90e449bd8000) has exports, disconnecting them 00000020:00080000:2.0:1788846048.453843:0:15096:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90e47518a000), last request at 1788845809 00000020:00000080:2.0:1788846048.453847:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271511 00000020:00080000:2.0:1788846048.453869:0:15096:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e47518a000): rc 0 00000020:00000080:2.0:1788846048.453873:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e47518a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788846048.453935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47518a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788846048.460738:0:15096:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788846048.461122:0:15096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846048.461127:0:15096:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788846048.461135:0:15096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788846048.461170:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e450dc1800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788846048.463075:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846048.463089:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788846048.463095:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e446b28000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788846048.463100:0:15096:0:(genops.c:844:class_export_destroy()) destroying export ffff90e446b28000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788846048.463107:0:15096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788846048.463180:0:15096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e451417000 1 00000020:00000080:0.0:1788846048.463185:0:15096:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271438 00000020:00000080:0.0:1788846048.463191:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e4464c6800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788846048.463205:0:15096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788846048.463219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4464c6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788846048.463230:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846048.463234:0:15096:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788846048.463237:0:15096:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90e449bd99b8) has no exports 00000020:00000080:0.0:1788846048.724003:0:15096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846048.724016:0:15096:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788846048.724033:0:15096:0:(genops.c:885:class_export_put()) final put ffff90e451410000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788846048.724037:0:15096:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451410000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788846048.724043:0:15096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788846048.724168:0:15096:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90e451417800 00000020:02000400:0.0:1788846048.724235:0:15096:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788846049.081913:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846050.108343:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846051.130102:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846051.642820:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702435584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788846051.642900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846051.642970:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702435584 00000100:00100000:0.0:1788846051.642978:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702435584 00000100:00100000:0.0:1788846051.643032:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788846051.643041:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702435584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788846051.643070:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788846051.643111:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702435584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846051.643119:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1788846051.643139:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846051.643175:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702435584:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788846052.156686:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788846052.156693:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788846052.156697:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e47b582000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846052.156706:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 431 00000100:00080000:0.0:1788846052.156711:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788846052.156717:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90e47b582000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846052.156751:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b2a00 x1875740702435840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846052.156769:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788846052.156772:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788846052.156774:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e46e34a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846052.156786:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 431 00000100:00080000:0.0:1788846052.156788:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788846052.156792:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90e46e34a000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846052.156806:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b1c00 x1875740702435968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846052.156814:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788846052.156817:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788846052.156818:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e3424f2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846052.156821:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 431 00000100:00080000:0.0:1788846052.156823:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788846052.156836:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90e3424f2800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846052.156847:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b2680 x1875740702436096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846052.156886:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788846052.156889:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788846052.156891:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e342a21800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846052.156895:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 431 00000100:00080000:0.0:1788846052.156898:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788846052.156901:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e342a21800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846052.156913:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b1880 x1875740702436480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846052.156968:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702435712:0@lo:400:kworker.0 00000400:00000100:0.0:1788846052.157017:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875740702435712 offset 0 length 224: 4 00000100:00100000:0.0:1788846052.157067:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702436736:0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.157107:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.157136:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846052.157144:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702436224:0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.157171:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.157204:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702435840:0@lo:38:kworker.0 00000100:00100000:0.0:1788846052.157278:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.157300:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702435968:0@lo:38:kworker.0 00000100:00100000:0.0:1788846052.157321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.157337:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702436096:0@lo:38:kworker.0 00000100:00100000:0.0:1788846052.157360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.157379:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702436480:0@lo:38:kworker.0 00000100:00100000:0.0:1788846052.157401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.157433:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702436608:0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.157458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.157478:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846052.157484:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702436352:0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.157510:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.157561:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702436736 00000100:00100000:0.0:1788846052.157568:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702436736 00000100:00100000:0.0:1788846052.157614:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702436352 00000100:00100000:0.0:1788846052.157617:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702436352 00000100:00100000:0.0:1788846052.157641:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788846052.157650:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702436736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.157702:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702436736:12345-0@lo:400:kworker.0 Request processed in 53us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846052.157710:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788846052.157736:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788846052.157742:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702436352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.157776:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702436352:12345-0@lo:400:kworker.0 Request processed in 34us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846052.157783:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788846052.157800:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702436224 00000100:00100000:0.0:1788846052.157804:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702436224 00000100:00100000:0.0:1788846052.157836:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702435968 00000100:00100000:0.0:1788846052.157839:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702435968 00000100:00100000:0.0:1788846052.157848:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702436096 00000100:00100000:0.0:1788846052.157850:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702436096 00000100:00100000:0.0:1788846052.157857:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702436480 00000100:00100000:0.0:1788846052.157859:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702436480 00000100:00100000:0.0:1788846052.157866:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788846052.157872:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702436224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.157908:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875740702436224:12345-0@lo:400:kworker.0 Request processed in 37us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846052.157914:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788846052.157924:0:12145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702436608 00000100:00100000:0.0:1788846052.157927:0:12145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702436608 00000100:00100000:0.0:1788846052.157944:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788846052.157950:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702436608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.157980:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875740702436608:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846052.157986:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788846052.157997:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788846052.158001:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1875740702435968:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788846052.158017:0:12145:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846052.158061:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1875740702435968:12345-0@lo:38:kworker.0 Request processed in 58us (738us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846052.158068:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788846052.158082:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788846052.158086:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1875740702436096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788846052.158096:0:12145:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846052.158122:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1875740702436096:12345-0@lo:38:kworker.0 Request processed in 35us (761us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846052.158128:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788846052.158143:0:12145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788846052.158149:0:12145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1875740702436480:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788846052.158160:0:12145:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846052.158188:0:12145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3639:x1875740702436480:12345-0@lo:38:kworker.0 Request processed in 38us (786us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846052.158194:0:12145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788846052.158213:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702435840 00000100:00100000:0.0:1788846052.158216:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702435840 00000100:00100000:0.0:1788846052.158237:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788846052.158242:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702435840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788846052.158251:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846052.158277:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702435840:12345-0@lo:38:kworker.0 Request processed in 33us (999us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788846052.158282:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:0.0:1788846052.158317:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788846052.158321:0:6512:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846052.158359:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702436352:0@lo:400:kworker.0 00010000:00080000:0.0:1788846052.158382:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90e47d3b2d80 x1875740702436608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846052.158392:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702436608:0@lo:400:kworker.0 00000100:00080000:0.0:1788846052.158427:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47b582000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846052.158432:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846052.158436:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702435840:0@lo:38:kworker.0 00000100:00080000:0.0:1788846052.158444:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e46e34a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846052.158447:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846052.158450:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702435968:0@lo:38:kworker.0 00000100:00080000:0.0:1788846052.158457:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e3424f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846052.158460:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846052.158463:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702436096:0@lo:38:kworker.0 00000100:00080000:0.0:1788846052.158472:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e342a21800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846052.158476:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846052.158478:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702436480:0@lo:38:kworker.0 00010000:00080000:0.0:1788846052.158509:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90e47d3b3800 x1875740702436224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846052.158518:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3642:1875740702436224:0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.158554:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702436736:0@lo:400:kworker.0 00010000:00010000:1.0:1788846052.171359:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846052.665875:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702436864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846052.665945:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846052.666097:0:11274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702436864 00000100:00100000:2.0:1788846052.666104:0:11274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702436864 00000100:00100000:2.0:1788846052.666155:0:11274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788846052.666164:0:11274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702436864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788846052.666190:0:11274:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788846052.666252:0:11274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702436864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846052.666268:0:11274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788846052.666317:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702436864:0@lo:13:osp-pre-1-1.0 00000020:01000004:2.0:1788846052.877500:0:15297:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788846052.904745:0:15297:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788846052.904807:0:15297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.904834:0:15297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.904842:0:15297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.904850:0:15297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.904879:0:15297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788846052.904886:0:15297:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788846052.904914:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846052.904918:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788846052.904924:0:15297:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788846052.904931:0:15297:0:(import.c:65:import_set_state_nolock()) ffff90e46e34a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788846052.904937:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846052.904938:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788846052.904942:0:15297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788846052.905693:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846052.905720:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.905730:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846052.905735:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.905746:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846052.905753:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846052.905759:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846052.905762:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788846052.905765:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788846052.905809:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.905816:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846052.905860:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.905867:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c000/0x21b4d561382719a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719a9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.905880:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846052.905882:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846052.905884:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846052.905891:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788846052.905920:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702436992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846052.905993:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846052.906052:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702436992 00000100:00100000:3.0:1788846052.906058:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702436992 00000100:00100000:3.0:1788846052.906094:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788846052.906101:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4517d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1875740702436992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788846052.906107:0:6501:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846052 with bad export cookie 2428800712590169186 00010000:00010000:0.0:1788846052.910753:0:15297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.910796:0:15297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.910803:0:15297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.910809:0:15297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.910881:0:15297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846052.910890:0:15297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.910897:0:15297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.910904:0:15297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.910910:0:15297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.910939:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846052.910947:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.910955:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846052.910965:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.910975:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846052.910982:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846052.910988:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846052.910991:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788846052.911037:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.911044:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788846052.911187:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702437120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846052.911257:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788846052.911369:0:15297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846052.911378:0:15297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911385:0:15297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911404:0:15297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911411:0:15297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911425:0:15297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788846052.911436:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846052.911440:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911446:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441443400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846052.911449:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911456:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846052.911462:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846052.911467:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846052.911469:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788846052.911472:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788846052.911489:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911495:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846052.911516:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911972:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441443400/0x21b4d5613827187c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271883 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.911995:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846052.911999:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912005:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846052.912007:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912015:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846052.912020:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846052.912025:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788846052.912026:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788846052.912028:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788846052.912045:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912050:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788846052.912057:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912064:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475065600/0x21b4d56138271c18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d56138271c1f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912093:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846052.912095:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846052.912097:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846052.912113:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702437248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846052.912156:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.912189:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846052.912195:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702437376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846052.912214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788846052.912239:0:15297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912247:0:15297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912253:0:15297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912259:0:15297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912271:0:15297:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788846052.912274:0:15297:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788846052.912277:0:15297:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1788846052.912320:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846052.912324:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912331:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e4820ee600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846052.912339:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912347:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788846052.912352:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846052.912356:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788846052.912358:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788846052.912360:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788846052.912373:0:7456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.912379:0:7456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846052.912439:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.912446:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d561382719b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d561382719b7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846052.912456:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846052.912458:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846052.912460:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846052.912472:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788846052.912480:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788846052.914769:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702437120 00000100:00100000:2.0:1788846052.914784:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702437120 00000100:00100000:2.0:1788846052.914838:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788846052.914848:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702437248 00000100:00100000:2.0:1788846052.914851:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702437248 00000100:00100000:2.0:1788846052.914862:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788846052.914880:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702437376 00000100:00100000:2.0:1788846052.914883:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702437376 00000100:00100000:2.0:1788846052.914989:0:15298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788846052.915000:0:15298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875740702437120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788846052.915008:0:15298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846052 with bad export cookie 2428800712590169186 00010000:00010000:0.0:1788846052.915916:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.915930:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4820ee600/0x21b4d56138271565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x21b4d5613827156c expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846052.915953:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846052.915955:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846052.915958:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788846052.915983:0:15297:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788846052.915989:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788846052.915994:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846052.916001:0:15297:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788846052.916007:0:15297:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90e34377d000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846052.916013:0:15297:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90e341e4b000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846052.916042:0:15297:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff90e46d51b370) has exports, disconnecting them 00000020:00080000:0.0:1788846052.916047:0:15297:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90e34377d000), last request at 1788846052 00000020:00000080:0.0:1788846052.916056:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271844 00000100:00080000:0.0:1788846052.916075:0:15297:0:(import.c:65:import_set_state_nolock()) ffff90e34377f000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788846052.916118:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788846052.916132:0:15297:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e34377d000): rc 0 00000020:00000080:0.0:1788846052.916134:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e34377d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788846052.916145:0:15297:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90e341e4b000), last request at 1788846052 00000020:00000080:0.0:1788846052.916148:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827171e 00000100:00080000:0.0:1788846052.916154:0:15297:0:(import.c:65:import_set_state_nolock()) ffff90e341e49000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788846052.916177:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34377d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788846052.916224:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e34377f000 for lustre-MDT0001 00010000:00010000:0.0:1788846052.916232:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788846052.916240:0:15297:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e341e4b000): rc 0 00000020:00000080:0.0:1788846052.916242:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e341e4b000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788846052.916252:0:15297:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb1f081537ae0 00000020:00000080:0.0:1788846052.916263:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e341e4b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788846052.916298:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e341e49000 for lustre-MDT0001 00000100:00080000:0.0:1788846052.916320:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846052.916330:0:15297:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff90e343a3b800 x1875740702433920/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788846063 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846052.916340:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788846052.917144:0:15297:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788846052.917151:0:15297:0:(import.c:65:import_set_state_nolock()) ffff90e47b582000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788846052.918860:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846052.918897:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702437504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846052.918971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846052.919160:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702433920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846052.919250:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788846052.919260:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1788846052.919591:0:15298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1875740702437120:12345-0@lo:103:ldlm_bl.0 Request processed in 4589us (8332us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846052.919601:0:15298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788846052.919622:0:15298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702437504 00000100:00100000:2.0:1788846052.919630:0:15298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702437504 00000100:00100000:2.0:1788846052.919661:0:15298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788846052.919668:0:15298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1875740702437248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788846052.919674:0:15298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846052 with bad export cookie 2428800712590169186 00000100:00100000:2.0:1788846052.919718:0:15298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1875740702437248:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (7561us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846052.919724:0:15298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788846052.919735:0:15298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846052.919739:0:15298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1875740702437376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788846052.919743:0:15298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846052 with bad export cookie 2428800712590169186 00000100:00100000:2.0:1788846052.919766:0:15298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3642:x1875740702437376:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (7550us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846052.919771:0:15298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846052.919782:0:15298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788846052.919785:0:15298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1875740702437504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788846052.919789:0:15298:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788846052 with bad export cookie 2428800712590169186 00000100:00100000:2.0:1788846052.919813:0:15298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1875740702437504:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (842us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788846052.919843:0:15298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788846052.919981:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788846052.919986:0:3642:0:(import.c:65:import_set_state_nolock()) ffff90e47b586800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788846052.919990:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788846052.920251:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788846052.927442:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4517d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1875740702436992:12345-0@lo:103:ldlm_bl.0 Request processed in 21334us (21443us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788846052.927457:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788846052.929713:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788846052.952709:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.120@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788846052.952715:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788846052.952724:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e47d3b3b80 x1875740702435712/t0(0) o400->MGC192.168.203.120@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788846068 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846052.952738:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e3438ebb80 x1875740702436992/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846068 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846052.952749:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e343a38000 x1875740702437120/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846068 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846052.952758:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e3438e9c00 x1875740702437248/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846068 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846052.952767:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e3438eb100 x1875740702437376/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846068 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846052.952776:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e3438ead80 x1875740702437504/t0(0) o103->MGC192.168.203.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788846068 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788846052.952924:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788846052.952928:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788846052.952929:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788846052.953108:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90e47b586800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788846052.953137:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702436992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846052.953169:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3641:1875740702437120:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788846052.954558:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90e47b586800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788846052.954586:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3640:1875740702437504:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788846052.954670:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788846052.954689:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1788846052.954700:0:15297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788846052.954703:0:3642:0:(import.c:65:import_set_state_nolock()) ffff90e47b586800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846052.954709:0:3642:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 193 00000100:00080000:0.0:1788846052.954715:0:3642:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff90e47b586800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846052.954746:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b3800 x1875740702437632/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788846052.954756:0:15297:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788846052.954768:0:15297:0:(import.c:65:import_set_state_nolock()) ffff90e342762000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788846052.954798:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3639:1875740702437632:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788846052.954857:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875740702437632 offset 0 length 520: 4 00000100:00100000:0.0:1788846052.954944:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702437248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846052.954950:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702437760:0@lo:9:umount.0 00000100:00100000:0.0:1788846052.954953:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702435712:0@lo:400:kworker.0 00000100:00100000:0.0:1788846052.954970:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3642:1875740702437376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846052.955072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788846052.955120:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788846052.955123:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788846052.955134:0:15297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788846052.955197:0:15297:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788846052.955209:0:15297:0:(import.c:65:import_set_state_nolock()) ffff90e3424f7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788846052.955293:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702437888:0@lo:9:umount.0 00000100:00100000:1.0:1788846052.955321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846052.955353:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702437760 00000100:00100000:1.0:1788846052.955360:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702437760 00000100:00100000:1.0:1788846052.955398:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702437888 00000100:00100000:1.0:1788846052.955401:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702437888 00000100:00100000:1.0:1788846052.955423:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788846052.955431:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1875740702437760:12345-0@lo:9:umount.0 00000100:00100000:0.0:1788846052.955437:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788846052.955444:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1875740702437888:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788846052.955455:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382718ad 00000020:00000080:1.0:1788846052.955456:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271779 00000100:00080000:1.0:1788846052.955463:0:8432:0:(import.c:65:import_set_state_nolock()) ffff90e47d13d000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788846052.955463:0:8430:0:(import.c:65:import_set_state_nolock()) ffff90e47f42d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788846052.955503:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:0.0:1788846052.955503:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788846052.955663:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3639:x1875740702437760:12345-0@lo:9:umount.0 Request processed in 232us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846052.955670:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:1.0:1788846052.955696:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846052.955719:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e342762000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788846052.955727:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788846052.955729:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788846052.955742:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702437760:0@lo:9:umount.0 00000020:00080000:3.0:1788846052.955909:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90e46d51b370) has no exports 00010000:00010000:1.0:1788846052.957013:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846052.957050:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3639:x1875740702437888:12345-0@lo:9:umount.0 Request processed in 1603us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846052.957059:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788846052.961926:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e3424f7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788846052.961945:0:3639:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788846052.961947:0:3639:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788846052.961954:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702437888:0@lo:9:umount.0 00000020:00080000:2.0:1788846052.964969:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90e46d51b370) has no exports 00000020:01000000:3.0:1788846053.038565:0:15297:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e47d2c1120 - data ffff90e478ad9e58/ffff90e3437ccc00 00000020:01000000:3.0:1788846053.038747:0:15297:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e47d07f660 - data ffff90e4789cc288/ffff90e47d0e6c00 00000001:00000004:2.0:1788846053.051681:0:15297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788846053.099994:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846053.100005:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788846053.100016:0:15297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788846053.102404:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788846053.102411:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788846053.102437:0:15297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846053.102439:0:15297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788846053.102659:0:8890:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788846053.102664:0:8890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788846053.102673:0:8890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788846053.103340:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788846053.103345:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788846053.103361:0:15297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846053.103363:0:15297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788846053.104783:0:9818:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788846053.104790:0:9818:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788846053.104803:0:9818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788846053.107439:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271588 00000020:00000080:2.0:1788846053.107453:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e46d52c000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788846053.107659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46d52c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788846053.111799:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827159d 00000020:00000080:2.0:1788846053.111814:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e46d52d000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788846053.111836:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788846053.111843:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846053.111853:0:15297:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788846053.111858:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90e46d51cd28) has no exports 00000004:01000000:2.0:1788846053.112052:0:15297:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788846053.112060:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382718a6 00000020:00000080:2.0:1788846053.112065:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e34366f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788846053.112069:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788846053.112072:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846053.112079:0:15297:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788846053.112082:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff90e34387b370) has no exports 00000020:00000080:2.0:1788846053.112088:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827189f 00000020:00000080:2.0:1788846053.112091:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e3424f6800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788846053.112454:0:15297:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788846053.112459:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788846053.112463:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788846053.112469:0:15297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846053.112471:0:15297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788846053.112505:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846053.112512:0:15297:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846053.112538:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271764 00000020:00000080:2.0:1788846053.112543:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e341e48800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788846053.112547:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788846053.112551:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846053.112555:0:15297:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788846053.112557:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff90e3426599b8) has no exports 00000020:00000080:2.0:1788846053.112561:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827175d 00000020:00000080:2.0:1788846053.112564:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e342765800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788846053.112719:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46d52d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788846053.112728:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34366f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788846053.112733:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e3424f6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788846053.112739:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e3424f7000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788846053.112745:0:37:0:(genops.c:885:class_export_put()) final put ffff90e34366d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788846053.112747:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e34366d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788846053.112751:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788846053.112833:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e341e48800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788846053.112837:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342765800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788846053.115629:0:15297:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788846053.115637:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788846053.115641:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788846053.115649:0:15297:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788846053.115651:0:15297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788846053.115745:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846053.115758:0:15297:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788846053.115777:0:15297:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788846053.115786:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382715c0 00000020:00000080:2.0:1788846053.115796:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e46e318000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788846053.115833:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342762000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788846053.115841:0:37:0:(genops.c:885:class_export_put()) final put ffff90e342765000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788846053.115844:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342765000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788846053.115864:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788846053.121997:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788846053.122041:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846053.122052:0:15297:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788846053.122064:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90e46e1c4d28) has no exports 00000020:00000080:2.0:1788846053.122075:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382715b9 00000020:00000080:2.0:1788846053.122083:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e47518b000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788846053.123487:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e318000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00010000:01000000:0.0:1788846053.133764:0:15297:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788846053.133782:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788846053.133787:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788846053.133795:0:15297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846053.135180:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47518b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788846053.137603:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846053.137618:0:15297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788846053.137649:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846053.137651:0:15297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788846053.137657:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e4437d7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788846053.137671:0:15297:0:(genops.c:844:class_export_destroy()) destroying export ffff90e4437d7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788846053.137679:0:15297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788846053.137860:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382715a4 00000020:00000080:0.0:1788846053.137867:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e46d529000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788846053.137873:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788846053.137876:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846053.137881:0:15297:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788846053.137885:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90e46d5199b8) has no exports 00000020:00000080:0.0:1788846053.137903:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846053.137905:0:15297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788846053.137909:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382715ab 00000020:00000080:0.0:1788846053.137912:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e46d52b000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788846053.137919:0:15297:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e47518c000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788846053.137922:0:15297:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e47518c000 2 00000020:01000004:0.0:1788846053.137925:0:15297:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e47518c000 from lustre-MDT0001 00000020:00000080:0.0:1788846053.137940:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846053.137942:0:15297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788846053.137944:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e46d528800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788846053.137946:0:15297:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46d528800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788846053.137953:0:15297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788846053.138106:0:15297:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788846053.138110:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788846053.138113:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846053.138116:0:15297:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788846053.138123:0:15297:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90e46e348000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846053.138128:0:15297:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff90e449bdb370) has exports, disconnecting them 00000020:00080000:0.0:1788846053.138133:0:15297:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90e46e348000), last request at 1788845826 00000020:00000080:0.0:1788846053.138136:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382715ff 00000020:00080000:0.0:1788846053.138147:0:15297:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e46e348000): rc 0 00000020:00000080:0.0:1788846053.138150:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e46e348000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788846053.139672:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47b582000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788846053.139685:0:37:0:(genops.c:885:class_export_put()) final put ffff90e451767000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788846053.139688:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451767000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788846053.139694:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788846053.139827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46d529000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788846053.139831:0:37:0:(genops.c:885:class_export_put()) final put ffff90e46d529800/lustre-MDD0001_UUID 00000020:00000080:3.0:1788846053.139833:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46d529800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788846053.139836:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788846053.140017:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46d52b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788846053.140022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e348000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788846053.171598:0:15297:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788846053.171608:0:15297:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788846053.171612:0:15297:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788846053.171619:0:15297:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846053.171651:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e46e34a000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788846053.171836:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846053.171845:0:15297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788846053.171851:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e46e1be000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788846053.171855:0:15297:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e1be000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788846053.171868:0:15297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788846053.171947:0:15297:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e47518c000 1 00000020:00000080:3.0:1788846053.171953:0:15297:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d5613827153b 00000020:00000080:3.0:1788846053.171960:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e451761800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788846053.171968:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788846053.171987:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e451761800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788846053.172007:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846053.172012:0:15297:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788846053.172017:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90e449bdcd28) has no exports 00010000:00010000:0.0:1788846053.458550:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788846053.487178:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846053.487193:0:15297:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788846053.487200:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e47518b800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788846053.487204:0:15297:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47518b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788846053.487217:0:15297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788846053.487338:0:15297:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90e47518f800 00000020:01000000:1.0:1788846053.487359:0:15297:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788846053.487363:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846053.487368:0:15297:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788846053.487371:0:15297:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90e450c6b370) has no exports 00000100:00100000:2.0:1788846053.487918:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90e447c13400:6517] 2 exiting: rc = 0 00000100:00100000:0.0:1788846053.489688:0:12145:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff90e343930a00:12145] 4 exiting: rc = 0 00000100:00100000:0.0:1788846053.489935:0:7876:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90e4751dda00:7876] 3 exiting: rc = 0 00000100:00100000:1.0:1788846053.491191:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90e447c12c00:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1788846053.493297:0:6515:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90e45166f200:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1788846053.493479:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.493489:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.493498:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.493509:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494925:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494944:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494951:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494957:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494963:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494969:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494976:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494982:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494989:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.494995:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495000:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495006:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495148:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495156:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495161:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495169:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495176:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495181:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495187:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495193:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495200:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495206:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495222:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495229:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495236:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495242:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495249:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495254:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495261:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495282:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495288:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495294:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495300:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495306:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495311:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495317:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495324:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495330:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495336:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495343:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495349:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495355:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495362:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495369:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495375:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495380:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495387:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495392:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495397:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495403:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495408:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495413:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495418:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495423:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495430:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495436:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495442:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495448:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495454:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.495468:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846053.503256:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90e46047d400:6519] 1 exiting: rc = 0 00000100:00100000:3.0:1788846053.503382:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90e480085000:6518] 0 exiting: rc = 1 00000100:00100000:1.0:1788846053.504099:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504108:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504115:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504121:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504128:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504134:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504141:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504148:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504154:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504163:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504169:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504177:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504185:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504192:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504199:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504220:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504227:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504234:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504240:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504246:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504253:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504260:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504265:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504271:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504278:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504283:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504288:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504294:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504299:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504304:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504309:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504315:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504320:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504325:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504330:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504335:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504340:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504346:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504352:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504359:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504364:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504370:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504375:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504380:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504385:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504389:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504394:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504400:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504406:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504411:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504424:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504430:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504434:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504439:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504444:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504449:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504453:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504458:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504463:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504468:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504473:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504478:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504483:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.504489:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505236:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90e469a7e600:6520] 0 exiting: rc = 1 00000100:00100000:3.0:1788846053.505418:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90e469a7ea00:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1788846053.505490:0:7612:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff90e47d096e00:7612] 2 exiting: rc = 0 00000100:00100000:1.0:1788846053.505759:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505767:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505776:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505782:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505787:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505793:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505800:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505806:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505812:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505829:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505848:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505855:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505860:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505866:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505872:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505878:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505883:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505890:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505896:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505901:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505923:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505929:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505948:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505955:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505961:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505966:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505973:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505988:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.505999:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506008:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506016:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506026:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506036:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506046:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506204:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506216:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506224:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506233:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506243:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506250:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506260:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506271:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506282:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506292:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506303:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506311:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506346:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506354:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506361:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506371:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506383:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506390:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506398:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506409:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506419:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506443:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506455:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506464:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506508:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506926:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506936:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506942:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506948:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.506963:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846053.526030:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90e469a7fe00:6522] 0 exiting: rc = 1 00000100:00100000:3.0:1788846053.526263:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90e469b86400:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1788846053.526376:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526383:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526388:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526393:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526414:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526420:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526425:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526430:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526435:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526439:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526444:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526449:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526454:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526459:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526465:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526470:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526475:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526479:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526484:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526488:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526493:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526498:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526503:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526507:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526512:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.526516:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527943:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527949:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527954:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527959:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527964:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527969:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527975:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527980:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527986:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527992:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.527998:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528177:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528187:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528205:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528210:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528216:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528222:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528228:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528233:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528238:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528244:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528249:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528254:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528259:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528265:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528269:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528274:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528278:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528282:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528287:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528291:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528295:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528300:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528304:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528309:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528314:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528318:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.528323:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846053.529447:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90e469b87600:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1788846053.529990:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90e469b87800:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1788846053.530112:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530119:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530125:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530130:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530136:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530141:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530146:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530152:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530158:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530163:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530179:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530184:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530190:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530197:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530203:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530209:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530215:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530220:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530226:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530232:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530238:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530243:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530250:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530256:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530261:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530266:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530271:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530276:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530281:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530286:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530292:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530297:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530302:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530308:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530313:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530318:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530323:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530328:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530334:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530339:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530345:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530350:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530355:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530360:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530365:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530376:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530382:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530387:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530392:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530398:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530403:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530407:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530411:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530415:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530420:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530425:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530430:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530435:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530441:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530447:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530452:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530456:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530461:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.530466:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532466:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90e469b86a00:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1788846053.532651:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90e450156e00:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1788846053.532794:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532801:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532807:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532812:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532827:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532833:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532838:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532843:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532849:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532856:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532862:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532867:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532872:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532878:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532884:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532900:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532906:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532911:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532917:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532922:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532928:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532933:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532939:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532945:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532951:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532956:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532962:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532967:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532973:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532978:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532984:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532988:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532993:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.532998:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533003:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533022:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533029:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533035:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533041:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533048:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533054:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533059:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533065:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533070:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533075:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533089:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533095:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533101:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533106:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533112:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533124:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533129:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533134:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533139:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533144:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533149:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533155:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533160:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533165:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533171:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533177:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533182:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533187:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.533192:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.534363:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90e446b20800:6529] 1 exiting: rc = 0 00000100:00100000:2.0:1788846053.534628:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90e450157c00:6528] 0 exiting: rc = 1 00000100:00100000:2.0:1788846053.538403:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90e446b20400:6530] 2 exiting: rc = 0 00000100:00100000:0.0:1788846053.539312:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539321:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539327:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539333:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539339:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539345:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539351:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539357:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539363:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539369:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539375:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539382:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539403:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539410:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539415:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539420:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539426:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539432:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539438:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539443:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539467:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539472:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539477:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539482:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539487:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539492:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539497:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539503:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539508:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539514:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539940:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539952:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539961:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539971:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539979:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.539989:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540245:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540257:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540266:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540275:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540283:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540292:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540301:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540309:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540319:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540328:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540337:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540343:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540349:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540355:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540360:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540367:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540377:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540386:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540392:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540408:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540413:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540425:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540431:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540436:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540443:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540449:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540454:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846053.540460:0:15297:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788846053.548231:0:15297:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846053.548251:0:15297:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788846053.548259:0:15297:0:(genops.c:885:class_export_put()) final put ffff90e47b585000/MDS_uuid 00000020:00000080:0.0:1788846053.548265:0:15297:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47b585000/MDS_uuid for MDS 00000020:01000000:0.0:1788846053.548274:0:15297:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788846053.548433:0:15297:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788846054.521648:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846055.548600:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846056.572954:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846057.275734:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788846057.277612:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846057.277617:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788846057.277620:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788846057.277624:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e3424f2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846057.277634:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1788846057.277639:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788846057.277645:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90e3424f2800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846057.278885:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ec700 x1875740702438016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846057.278955:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702438016:0@lo:38:kworker.0 00000400:00000100:2.0:1788846057.279212:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702438016 offset 0 length 520: 4 00000100:00080000:3.0:1788846057.279300:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788846057.279304:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788846057.279308:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e342a21800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846057.279313:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1788846057.279317:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788846057.279322:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e342a21800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846057.279335:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4efb80 x1875740702438272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846057.279372:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702438272:0@lo:38:kworker.0 00000400:00000100:2.0:1788846057.279392:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702438272 offset 0 length 520: 4 00000100:00100000:2.0:1788846057.279705:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702438400:0@lo:400:kworker.0 00000400:00000100:2.0:1788846057.279726:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702438400 offset 0 length 224: 4 00000100:00100000:3.0:1788846057.280256:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702438144:0@lo:400:kworker.0 00000400:00000100:3.0:1788846057.280281:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702438144 offset 0 length 224: 4 00000020:01000004:1.0:1788846057.316185:0:15499:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788846057.336833:0:15499:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788846057.336887:0:15499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846057.336903:0:15499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846057.336911:0:15499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846057.336918:0:15499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846057.336938:0:15499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788846057.336943:0:15499:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788846057.336968:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846057.336974:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846057.336982:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2a00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846057.337000:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846057.337009:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846057.337017:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846057.337023:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788846057.337026:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788846057.337028:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788846057.337041:0:7456:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e47b586800 00010000:00010000:1.0:1788846057.337044:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846057.337051:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2a00/0x21b4d56138271986 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d5613827198d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846057.337062:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846057.337063:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846057.337065:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846057.337078:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788846057.337090:0:15499:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e47f4ec700 x1875740702438016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846077 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846057.337113:0:15499:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788846057.337119:0:15499:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788846057.337124:0:15499:0:(import.c:65:import_set_state_nolock()) ffff90e3424f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788846057.337129:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788846057.337133:0:15499:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e47f4ec700 x1875740702438016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846077 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846057.337147:0:15499:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788846057.337150:0:15499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000100:00100000:0.0:1788846057.337365:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702438016:0@lo:38:kworker.0 00000100:00080000:1.0:1788846057.338511:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788846057.338562:0:15499:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e47f4ef800 x1875740702438144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846073 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846057.338581:0:15499:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788846057.338585:0:15499:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788846057.338605:0:15499:0:(import.c:65:import_set_state_nolock()) ffff90e47d13b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788846057.339743:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702438528:0@lo:39:umount.0 00000400:00000100:0.0:1788846057.339819:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702438528 offset 0 length 224: 4 00000100:00100000:2.0:1788846057.340361:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702438144:0@lo:400:kworker.0 00010000:00010000:0.0:1788846057.595983:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846058.617806:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788846058.816169:0:9508:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788846058.816179:0:9508:0:(genops.c:885:class_export_put()) final put ffff90e47f429000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788846058.818855:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788846058.818865:0:8426:0:(genops.c:885:class_export_put()) final put ffff90e47d138000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788846058.818945:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d138000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788846058.819012:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47d13d000 for lustre-OST0000 00000020:00000080:1.0:1788846058.822436:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47f429000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788846058.822511:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47f42d000 for lustre-OST0001 00010000:00010000:1.0:1788846059.641965:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846060.666804:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846061.689749:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846062.393710:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788846062.393720:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846062.393724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788846062.393727:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846062.393879:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702438656:0@lo:400:kworker.0 00000400:00000100:2.0:1788846062.393945:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702438656 offset 0 length 224: 4 00000100:00100000:0.0:1788846062.457813:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846052/real 1788846052] req@ffff90e47d3b3800 x1875740702437632/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788846062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846062.457845:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e47d3b3800 x1875740702437632/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788846062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788846062.457863:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47b586800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846062.457895:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788846062.457915:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3639:1875740702437632:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788846062.458134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788846062.458141:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788846062.458146:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e47b586800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846062.458152:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 436 00000100:00080000:1.0:1788846062.458158:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.120@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788846062.458167:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff90e47b586800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846062.458219:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344577800 x1875740702438784/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846062.458259:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788846062.458263:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788846062.458416:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3639:1875740702438784:0@lo:250:kworker.0 00000400:00000100:0.0:1788846062.458463:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875740702438784 offset 0 length 520: 4 00010000:00010000:1.0:1788846062.713905:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846063.738829:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846064.762847:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846065.785664:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846066.812395:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846067.514660:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788846067.514681:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846067.514684:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788846067.514687:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788846067.514833:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846067.520329:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702438912:0@lo:400:kworker.0 00000400:00000100:0.0:1788846067.520391:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702438912 offset 0 length 224: 4 00000100:00100000:0.0:1788846067.577838:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846057/real 1788846057] req@ffff90e344574700 x1875740702438528/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788846067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846067.577873:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e344574700 x1875740702438528/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788846067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788846067.577900:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47d13b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788846067.577928:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702438528:0@lo:39:umount.0 00000100:00080000:1.0:1788846067.577984:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788846067.577990:0:15499:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788846067.577995:0:15499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788846067.580888:0:15499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846067.580911:0:15499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846067.580920:0:15499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846067.580929:0:15499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846067.580946:0:15499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846067.580953:0:15499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846067.580960:0:15499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846067.580966:0:15499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846067.580990:0:15499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846067.581016:0:15499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788846067.581021:0:15499:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788846067.581049:0:15499:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788846067.581053:0:15499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788846067.581066:0:15499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846067.581072:0:15499:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788846067.581076:0:15499:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff90e341e54d28) has no exports 00000020:00080000:1.0:1788846067.581098:0:15499:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff90e341e54d28) has no exports 00010000:00010000:2.0:1788846067.582067:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846067.582078:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846067.582089:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846067.582094:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846067.582115:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846067.582123:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846067.582130:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788846067.582133:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788846067.582135:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788846067.582152:0:7456:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e47b586800 00010000:00010000:2.0:1788846067.582156:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846067.582162:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0d000/0x21b4d56138271994 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d5613827199b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846067.582197:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846067.582201:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846067.582206:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441443600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846067.582209:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846067.582217:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846067.582223:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846067.582228:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788846067.582231:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788846067.582232:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788846067.582239:0:7456:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e47b586800 00010000:00010000:2.0:1788846067.582242:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846067.582248:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441443600/0x21b4d56138271c0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138271c11 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846067.582259:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846067.582261:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846067.582263:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846067.583748:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788846067.583828:0:15499:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e443a80f00 - data ffff90e34204d0d8/ffff90e475c14c00 00000020:01000000:3.0:1788846067.584035:0:15499:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e342617960 - data ffff90e478ac4948/ffff90e475fab400 00100000:10000000:2.0:1788846067.609357:0:15499:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788846067.622310:0:15499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382716d8 00000020:00000080:0.0:1788846067.622322:0:15499:0:(genops.c:885:class_export_put()) final put ffff90e341e4a000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788846067.622347:0:15499:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e451767800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788846067.622351:0:15499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e451767800 2 00000020:01000004:0.0:1788846067.622354:0:15499:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e451767800 from lustre-OST0000 00000020:00000080:0.0:1788846067.622376:0:15499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846067.622387:0:15499:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788846067.622390:0:15499:0:(genops.c:885:class_export_put()) final put ffff90e341e4e000/lustre-OST0000_UUID 00000020:00000080:0.0:1788846067.622392:0:15499:0:(genops.c:844:class_export_destroy()) destroying export ffff90e341e4e000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788846067.622399:0:15499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788846067.622464:0:15499:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788846067.622468:0:15499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788846067.622472:0:15499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788846067.622477:0:15499:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788846067.622483:0:15499:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90e3424f0800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788846067.622489:0:15499:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff90e46e1c19b8) has exports, disconnecting them 00000020:00080000:0.0:1788846067.622493:0:15499:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90e3424f0800), last request at 1788845844 00000020:00000080:0.0:1788846067.622496:0:15499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271702 00000020:00080000:0.0:1788846067.622508:0:15499:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e3424f0800): rc 0 00000020:00000080:0.0:1788846067.622513:0:15499:0:(genops.c:885:class_export_put()) final put ffff90e3424f0800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788846067.623453:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e341e4a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788846067.623476:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e3424f0800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788846067.623514:0:15499:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788846067.623544:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788846067.623552:0:15499:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788846067.623559:0:15499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846067.623715:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e3424f2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788846067.623860:0:15499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846067.623881:0:15499:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788846067.623886:0:15499:0:(genops.c:885:class_export_put()) final put ffff90e3424f3800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788846067.623888:0:15499:0:(genops.c:844:class_export_destroy()) destroying export ffff90e3424f3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788846067.623906:0:15499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788846067.623970:0:15499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788846067.623974:0:15499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846067.623978:0:15499:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788846067.623983:0:15499:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90e3424f0000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788846067.623989:0:15499:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff90e34265b370) has exports, disconnecting them 00000020:00080000:3.0:1788846067.623993:0:15499:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90e3424f0000), last request at 1788845844 00000020:00000080:3.0:1788846067.623997:0:15499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271717 00000020:00080000:3.0:1788846067.624009:0:15499:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e3424f0000): rc 0 00000020:00000080:3.0:1788846067.624013:0:15499:0:(genops.c:885:class_export_put()) final put ffff90e3424f0000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788846067.624178:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e3424f0000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788846067.673658:0:15499:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788846067.673668:0:15499:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788846067.673673:0:15499:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788846067.673679:0:15499:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846067.674005:0:15499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846067.674015:0:15499:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788846067.674022:0:15499:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e451767800 1 00000020:00000080:3.0:1788846067.674028:0:15499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382716a0 00000020:00000080:3.0:1788846067.674035:0:15499:0:(genops.c:885:class_export_put()) final put ffff90e47d369000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788846067.680874:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47d13b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788846067.680891:0:38:0:(genops.c:885:class_export_put()) final put ffff90e47d138800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788846067.680902:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d138800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788846067.680914:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788846067.688110:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d369000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788846067.688483:0:15499:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788846067.688497:0:15499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846067.688507:0:15499:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788846067.688511:0:15499:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90e46e1c3370) has no exports 00010000:00010000:0.0:1788846067.834796:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788846067.884314:0:15499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788846067.884330:0:15499:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788846067.884336:0:15499:0:(genops.c:885:class_export_put()) final put ffff90e46e319800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788846067.884341:0:15499:0:(genops.c:844:class_export_destroy()) destroying export ffff90e46e319800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788846067.884357:0:15499:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788846067.887293:0:15499:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90e451762800 00000020:02000400:0.0:1788846067.887345:0:15499:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788846068.857870:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846069.882252:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846070.905902:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788846071.690636:0:15701:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788846071.709037:0:15701:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788846071.709133:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846071.709149:0:15701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846071.709157:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846071.709164:0:15701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846071.709193:0:15701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788846071.709200:0:15701:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788846071.709227:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788846071.709227:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846071.709235:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846071.709239:0:15701:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e47f4efb80 x1875740702438272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846077 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788846071.709244:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:0.0:1788846071.709248:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846071.709257:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846071.709259:0:15701:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:00010000:0.0:1788846071.709264:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788846071.709265:0:15701:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788846071.709270:0:15701:0:(import.c:65:import_set_state_nolock()) ffff90e342a21800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788846071.709274:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788846071.709278:0:15701:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e47f4efb80 x1875740702438272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788846077 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788846071.709284:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788846071.709285:0:15701:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 10000000:01000000:0.0:1788846071.709286:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:2.0:1788846071.709288:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 10000000:01000000:0.0:1788846071.709288:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788846071.709314:0:7456:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e47b586800 00010000:00010000:0.0:1788846071.709318:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846071.709325:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d5613827196a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138271971 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846071.709337:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846071.709339:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846071.709341:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846071.709912:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702438272:0@lo:38:kworker.0 00000100:00080000:2.0:1788846071.711012:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788846071.711027:0:15701:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e47f4eca80 x1875740702438400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846073 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846071.711115:0:15701:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e344575880 x1875740702438656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846078 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846071.711140:0:15701:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e343a38380 x1875740702438912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846083 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846071.711154:0:15701:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788846071.711178:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702438656:0@lo:400:kworker.0 00000100:00100000:2.0:1788846071.711179:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3641:1875740702438912:0@lo:400:kworker.0 00000100:00080000:2.0:1788846071.711205:0:15701:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788846071.711226:0:15701:0:(import.c:65:import_set_state_nolock()) ffff90e343668000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788846071.711270:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702439040:0@lo:39:umount.0 00000400:00000100:0.0:1788846071.711320:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875740702439040 offset 0 length 224: 4 00000100:00100000:1.0:1788846071.715640:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702438400:0@lo:400:kworker.0 00010000:00010000:2.0:1788846071.940177:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788846072.633914:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788846072.633941:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788846072.953849:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846073.977980:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846075.002749:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846076.030965:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846077.049742:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788846077.753834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788846077.753847:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788846077.881676:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846062/real 1788846062] req@ffff90e344577800 x1875740702438784/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788846077 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846077.881708:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e344577800 x1875740702438784/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788846077 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788846077.881728:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47b586800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846077.881803:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788846077.881808:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3639:1875740702438784:0@lo:250:kworker.0 00000100:00080000:3.0:1788846077.882406:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788846077.882413:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788846077.882416:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e47b586800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846077.882422:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1788846077.882427:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.120@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788846077.882432:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff90e47b586800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846077.882465:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ef100 x1875740702439168/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846077.882549:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3639:1875740702439168:0@lo:250:kworker.0 00000400:00000100:1.0:1788846077.882598:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875740702439168 offset 0 length 520: 4 00010000:00010000:0.0:1788846078.074583:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846079.097726:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846080.122084:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846081.147088:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846081.977831:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846071/real 1788846071] req@ffff90e343a38380 x1875740702439040/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788846081 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846081.977872:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e343a38380 x1875740702439040/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788846081 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788846081.977897:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343668000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788846081.977921:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702439040:0@lo:39:umount.0 00000100:00080000:2.0:1788846081.977965:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788846081.977971:0:15701:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788846081.977977:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788846081.979086:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.979103:0:15701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.979110:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.979118:0:15701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.979150:0:15701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846081.979158:0:15701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.979382:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846081.979390:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.979397:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c200 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846081.979401:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.979409:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846081.979417:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846081.979422:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788846081.979431:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788846081.979442:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e47b586800 00010000:00010000:3.0:1788846081.979446:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.979453:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0c200/0x21b4d56138271978 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d5613827197f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.979468:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846081.979470:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846081.979472:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846081.979651:0:15701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.979662:0:15701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.979668:0:15701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846081.979716:0:15701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788846081.979721:0:15701:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788846081.979727:0:15701:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788846081.979750:0:15701:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788846081.979754:0:15701:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788846081.979759:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846081.979765:0:15701:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788846081.979770:0:15701:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff90e4752e99b8) has no exports 00000020:00080000:2.0:1788846081.979803:0:15701:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff90e4752e99b8) has no exports 00000020:01000000:2.0:1788846081.983741:0:15701:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e443a802a0 - data ffff90e34204dbd0/ffff90e47b55b800 00000020:01000000:2.0:1788846081.983953:0:15701:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90e443a807e0 - data ffff90e4789d0438/ffff90e342b2a400 00010000:00010000:3.0:1788846081.986101:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846081.986117:0:7456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.986128:0:7456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441442400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846081.986132:0:7456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.986141:0:7456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846081.986147:0:7456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846081.986441:0:7456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788846081.986444:0:7456:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788846081.986447:0:7456:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788846081.986463:0:7456:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e47b586800 00010000:00010000:3.0:1788846081.986468:0:7456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.986494:0:7456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441442400/0x21b4d56138271bfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d56138271c03 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846081.986511:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846081.986513:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846081.986515:0:7456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788846082.011927:0:15701:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788846082.033139:0:15701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382717fe 00000020:00000080:1.0:1788846082.033152:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e341e4f800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788846082.033179:0:15701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e342932800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788846082.033183:0:15701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e342932800 2 00000020:01000004:1.0:1788846082.033186:0:15701:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90e342932800 from lustre-OST0001 00000020:00000080:1.0:1788846082.033214:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846082.033224:0:15701:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788846082.033226:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e47f42c800/lustre-OST0001_UUID 00000020:00000080:1.0:1788846082.033248:0:15701:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47f42c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788846082.033259:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1788846082.033302:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e341e4f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1788846082.034020:0:15701:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a0315653-1ca9-40fd-86ef-b83b7b1cadfd->MGS 00010000:00010000:1.0:1788846082.034039:0:15701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e4820ef600/0x21b4d56138271557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d5613827155e expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846082.034054:0:15701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e4820ef600/0x21b4d56138271557 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d5613827155e expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846082.034059:0:15701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788846082.034062:0:15701:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788846082.034065:0:15701:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788846082.034079:0:15701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e47b586800 00010000:00010000:1.0:1788846082.034083:0:15701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e4820ef600/0x21b4d56138271557 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d5613827155e expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846082.034101:0:15701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x21b4d561382719e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846082.034107:0:15701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x21b4d561382719e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846082.034112:0:15701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788846082.034114:0:15701:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788846082.034116:0:15701:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788846082.034124:0:15701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90e47b586800 00010000:00010000:1.0:1788846082.034127:0:15701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e342a0d600/0x21b4d561382719da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x21b4d561382719e1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788846082.034144:0:15701:0:(import.c:65:import_set_state_nolock()) ffff90e47b586800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788846082.034148:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788846082.034156:0:15701:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788846082.034158:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788846082.034162:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788846082.034172:0:15701:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90e47f4ef100 x1875740702439168/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788846097 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788846082.034196:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788846082.034199:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788846082.034400:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0315653-1ca9-40fd-86ef-b83b7b1cadfd:3639:1875740702439168:0@lo:250:kworker.0 10000000:01000000:1.0:1788846082.034613:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788846082.034630:0:15701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271454 00000020:00000080:1.0:1788846082.034646:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e47b581800/a0315653-1ca9-40fd-86ef-b83b7b1cadfd 00000020:01000000:1.0:1788846082.034667:0:15701:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.120@tcp (flags='') 00000020:00000080:3.0:1788846082.034736:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47b581800/a0315653-1ca9-40fd-86ef-b83b7b1cadfd for MGC192.168.203.120@tcp 00000020:00000080:1.0:1788846082.035332:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846082.035343:0:15701:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.120@tcp: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788846082.035348:0:15701:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90e450c6cd28) has no exports 10000000:01000000:3.0:1788846082.035565:0:6513:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788846082.035962:0:15701:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.120@tcp: client import never connected 00000100:00080000:1.0:1788846082.035967:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788846082.035971:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788846082.035974:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788846082.035976:0:15701:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788846082.036034:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846082.036063:0:15701:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.120@tcp (uuid a0315653-1ca9-40fd-86ef-b83b7b1cadfd) 00000020:01000000:1.0:1788846082.036088:0:15701:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788846082.036320:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e47b586800 for MGC192.168.203.120@tcp 00000020:00000080:3.0:1788846082.036329:0:38:0:(genops.c:885:class_export_put()) final put ffff90e47b587800/a0315653-1ca9-40fd-86ef-b83b7b1cadfd 00000020:00000080:3.0:1788846082.036332:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47b587800/a0315653-1ca9-40fd-86ef-b83b7b1cadfd for MGC192.168.203.120@tcp 00000020:01000000:3.0:1788846082.036337:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.120@tcp (a0315653-1ca9-40fd-86ef-b83b7b1cadfd) 00000020:00000080:1.0:1788846082.037047:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846082.037055:0:15701:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788846082.037062:0:15701:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90e342a26800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788846082.037069:0:15701:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff90e341e519b8) has exports, disconnecting them 00000020:00080000:1.0:1788846082.037073:0:15701:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90e342a26800), last request at 1788845862 00000020:00000080:1.0:1788846082.037078:0:15701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271828 00000020:00080000:1.0:1788846082.037101:0:15701:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e342a26800): rc 0 00000020:00000080:1.0:1788846082.037106:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e342a26800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788846082.038052:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342a26800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788846082.041269:0:15701:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788846082.041279:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788846082.041331:0:15701:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788846082.041337:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846082.041384:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e342a21800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788846082.041599:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788846082.041608:0:15701:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788846082.041613:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e342a24000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788846082.041617:0:15701:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342a24000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788846082.041632:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788846082.041718:0:15701:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788846082.041722:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788846082.041726:0:15701:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788846082.041732:0:15701:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff90e343668800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788846082.041738:0:15701:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff90e46e1c0000) has exports, disconnecting them 00000020:00080000:1.0:1788846082.041742:0:15701:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff90e343668800), last request at 1788845862 00000020:00000080:1.0:1788846082.041746:0:15701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d56138271836 00000020:00080000:1.0:1788846082.041756:0:15701:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90e343668800): rc 0 00000020:00000080:1.0:1788846082.041759:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e343668800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788846082.042864:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e343668800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788846082.047592:0:15701:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788846082.047603:0:15701:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788846082.047613:0:15701:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788846082.047632:0:15701:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788846082.047667:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90e343668000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788846082.118701:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788846082.118975:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788846082.119395:0:7456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788846082.119992:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90e442c32800:6499] 0 exiting: rc = 1 00000100:00100000:2.0:1788846082.120077:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90e442c32e00:6500] 1 exiting: rc = 0 00000100:00100000:3.0:1788846082.120373:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.121023:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90e446545400:6502] 1 exiting: rc = 0 00000100:00100000:0.0:1788846082.121127:0:15299:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff90e48034c600:15299] 4 exiting: rc = 0 00000100:00100000:3.0:1788846082.121389:0:15298:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90e344470c00:15298] 3 exiting: rc = 0 00000100:00100000:0.0:1788846082.121557:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90e446544400:6503] 2 exiting: rc = 0 00000100:00100000:2.0:1788846082.121995:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90e446544e00:6501] 0 exiting: rc = 1 00000100:00100000:3.0:1788846082.122282:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122305:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122312:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122318:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122323:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122328:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122334:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122339:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122344:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122349:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122355:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122368:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122375:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122380:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122387:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122392:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122398:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122404:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122409:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122416:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122423:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122429:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122434:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122439:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122444:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122450:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122455:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122461:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122465:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122470:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122475:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122480:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122485:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122490:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122495:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122501:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122514:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122651:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122658:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122663:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122668:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122673:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122677:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122682:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122688:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122693:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122698:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122703:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122707:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122713:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122717:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122722:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122727:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122733:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122738:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122743:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122748:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122753:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122758:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122763:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122768:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122772:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122953:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.122962:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788846082.124509:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788846082.124627:0:15701:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788846082.124634:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e3424f5000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788846082.124639:0:15701:0:(genops.c:844:class_export_destroy()) destroying export ffff90e3424f5000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788846082.124645:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788846082.124696:0:15701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e342932800 1 00000020:00000080:3.0:1788846082.124710:0:15701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x21b4d561382717cd 00000020:00000080:3.0:1788846082.124717:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e47f42c000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788846082.124738:0:15701:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788846082.124743:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788846082.124747:0:15701:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788846082.124752:0:15701:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff90e341e53370) has no exports 00000020:00000080:0.0:1788846082.124850:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47f42c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788846082.158733:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846082.158751:0:15701:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788846082.158757:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e342934800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788846082.158764:0:15701:0:(genops.c:844:class_export_destroy()) destroying export ffff90e342934800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788846082.158774:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788846082.159127:0:15701:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90e342936000 00000020:01000000:2.0:1788846082.159157:0:15701:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788846082.159161:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788846082.159165:0:15701:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788846082.159169:0:15701:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90e46d518000) has no exports 00000020:00000080:2.0:1788846082.159218:0:15701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788846082.159224:0:15701:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788846082.159496:0:15701:0:(genops.c:885:class_export_put()) final put ffff90e47d36f800/OSS_uuid 00000020:00000080:2.0:1788846082.159499:0:15701:0:(genops.c:844:class_export_destroy()) destroying export ffff90e47d36f800/OSS_uuid for OSS 00000020:01000000:2.0:1788846082.159503:0:15701:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788846082.159617:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90e4751e7400:8430] 0 exiting: rc = 1 00000100:00080000:0.0:1788846082.159939:0:6512:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788846082.160314:0:8906:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90e341e20800:8906] 3 exiting: rc = 0 00000100:00100000:1.0:1788846082.160386:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90e4437cfc00:8433] 2 exiting: rc = 0 00000100:00100000:1.0:1788846082.160435:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90e475217000:8432] 1 exiting: rc = 0 00000100:00100000:2.0:1788846082.160809:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160818:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160825:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160832:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160838:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160844:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160849:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160855:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160861:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160866:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160871:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160876:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160882:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160887:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160893:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160898:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160903:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160908:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160912:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160918:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160922:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160928:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160933:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160938:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160942:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160957:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160962:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160967:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160972:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160978:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160983:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160987:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160992:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.160997:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161004:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161010:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161014:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161020:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161025:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161029:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161035:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161041:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161047:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161052:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161057:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161062:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161067:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161072:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161077:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161083:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161088:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161093:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161099:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161104:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161116:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161123:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161128:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161133:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161138:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161143:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161155:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161160:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161165:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.161170:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.162970:0:11274:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff90e34393b200:11274] 2 exiting: rc = 0 00000100:00100000:2.0:1788846082.163108:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90e447c12e00:8434] 0 exiting: rc = 1 00000100:00100000:1.0:1788846082.163473:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90e446b20200:8435] 1 exiting: rc = 0 00000100:00100000:2.0:1788846082.163955:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.163964:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.163970:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.163976:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.163980:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.163985:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.163990:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.163995:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164000:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164006:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164012:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164017:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164023:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164028:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164034:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164040:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164045:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164049:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164055:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164060:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164064:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164069:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164074:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164080:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164084:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164090:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164095:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164101:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164107:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164112:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164131:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164136:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164141:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164147:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164153:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164158:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164162:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164167:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164172:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164176:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164316:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164325:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164331:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164337:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164342:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164347:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164352:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164357:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164362:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164367:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164373:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164378:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164383:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164388:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164393:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164398:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164403:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164408:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164414:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164418:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164423:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164428:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164433:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788846082.164439:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788846082.170724:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90e47d09b000:8438] 2 exiting: rc = 0 00000100:00100000:3.0:1788846082.171033:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90e47d09b200:8437] 1 exiting: rc = 0 00000100:00100000:2.0:1788846082.171509:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90e475d2e600:8436] 0 exiting: rc = 1 00000100:00100000:0.0:1788846082.172408:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172422:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172432:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172441:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172447:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172453:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172459:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172467:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172473:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172479:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172484:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172489:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172494:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172499:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172504:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172510:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172516:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172686:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172694:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172700:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172706:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172715:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172723:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172731:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172740:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172750:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172757:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172763:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172768:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172775:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172781:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172806:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172813:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172817:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172823:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172839:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172844:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172849:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172855:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172861:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172867:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172873:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172879:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172886:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172892:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172898:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172904:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172911:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172917:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172923:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172929:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172934:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172939:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172945:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172951:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172972:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172980:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172986:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.172993:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.173000:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.173006:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.173015:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.173021:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.173028:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.179036:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90e475f92600:8439] 0 exiting: rc = 1 00000100:00100000:0.0:1788846082.179782:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90e475f92a00:8440] 1 exiting: rc = 0 00000100:00100000:0.0:1788846082.179853:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179861:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179865:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179871:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179877:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179895:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179901:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179907:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179911:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179917:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179923:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179929:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179934:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179939:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179945:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179950:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179955:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179959:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179965:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179970:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179974:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179980:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179984:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179989:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.179994:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180000:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180006:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180012:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180016:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180022:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180026:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180032:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180037:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180042:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180046:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180051:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180056:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180061:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180066:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180070:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180084:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180088:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180094:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180099:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180104:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180109:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180113:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180118:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180123:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180128:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180133:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180138:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180142:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180147:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180151:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180156:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180161:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180167:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180173:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180178:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180197:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180202:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180208:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.180213:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788846082.181348:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90e475fa0c00:8442] 1 exiting: rc = 0 00000100:00100000:1.0:1788846082.181744:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90e475fa0e00:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1788846082.181930:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.181939:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.181944:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.181951:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.181957:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.181982:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.181989:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.181995:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182002:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182009:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182015:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182031:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182037:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182044:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182050:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182056:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182063:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182084:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182091:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182097:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182103:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182110:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182116:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182122:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182129:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182136:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182142:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182148:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182155:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182174:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182182:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182373:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182383:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182390:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182395:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182401:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182406:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182413:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182419:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182424:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182430:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182450:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182457:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182464:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182470:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182476:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182488:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182494:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182500:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182507:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182513:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182547:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182555:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182575:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182583:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182671:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182681:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182687:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182693:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182700:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182706:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182712:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182717:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788846082.182730:0:15701:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788846082.192076:0:15701:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788846104.719049:0:16468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788846115.390939:0:17067:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788846115.390946:0:17067:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788846115.390947:0:17067:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788846115.391079:0:17067:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e344550800 00000020:01000004:0.0:1788846115.391094:0:17067:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788846115.391101:0:17067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788846115.391114:0:17067:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90e343878000) 00000020:00000080:0.0:1788846115.391127:0:17067:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788846115.474089:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788846115.474412:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.476429:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.476775:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.477374:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.477978:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.478543:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.478828:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.479018:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.479949:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.482584:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.487015:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.487765:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.488099:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.488771:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.489557:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.490058:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.490563:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.490776:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.491036:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.491499:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.491838:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.492139:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.492662:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.492857:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.493157:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.493810:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.494097:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.494466:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.494690:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.494842:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.495111:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.495481:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788846115.495749:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788846115.496569:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788846115.499670:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788846115.500075:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788846115.500416:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788846115.500650:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788846115.500854:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788846115.501175:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788846115.501558:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788846115.501753:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788846115.502040:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788846115.502273:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788846115.502722:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788846115.502936:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788846115.504644:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788846115.505102:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1788846115.505367:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788846115.505788:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788846115.506075:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788846115.506349:0:17067:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:0.0:1788846115.507013:0:17067:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788846115.507227:0:17067:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788846115.507234:0:17067:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788846115.507244:0:17067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138272a11 00000020:01000004:0.0:1788846115.507250:0:17067:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788846115.507254:0:17067:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788846115.507258:0:17067:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e344550800 from MGS 00000020:01000004:0.0:1788846115.507261:0:17067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788846115.507271:0:17067:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90e34387cd28) 00000020:00000080:0.0:1788846115.507279:0:17067:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788846115.507330:0:17067:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e344550800 from MGS, refs=2 00080000:01000000:0.0:1788846115.507335:0:17067:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788846115.507340:0:17067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138272a1f 00000100:00100000:0.0:1788846115.507447:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788846115.507619:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788846115.507625:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788846115.508429:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788846115.508436:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788846115.509242:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846115.509471:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788846115.509476:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788846115.510023:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788846115.510030:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788846115.510485:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788846115.510492:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788846115.511217:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846115.511220:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846115.511222:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846115.511542:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846115.511545:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846115.511547:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846115.512408:0:17067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788846115.513943:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788846115.517203:0:17067:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788846115.517984:0:17079:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788846115.518028:0:17067:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788846115.518057:0:17067:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788846115.518861:0:17067:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788846115.519226:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846115.521068:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788846115.521082:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788846115.529545:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788846115.529564:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788846115.530709:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788846115.530718:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788846115.531357:0:17067:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788846115.531398:0:17067:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.120@tcp' 00000020:01000004:1.0:1788846115.531399:0:17067:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788846115.531430:0:17067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.120@tcp (typ=mgc) 00000020:00000080:1.0:1788846115.531443:0:17067:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.120@tcp (ffff90e34265b370) 00000020:00000080:1.0:1788846115.531458:0:17067:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788846115.531569:0:17067:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e450e6a800@MGC192.168.203.120@tcp: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788846115.531705:0:17067:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.120@tcp-0 is initialized 00000040:01000000:1.0:1788846115.531716:0:17067:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788846115.531969:0:17084:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788846115.534700:0:17086:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788846115.534785:0:17067:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.120@tcp (uuid 6db0807f-6150-4b75-b37b-0ed71f62ed94) 00000020:00000080:0.0:1788846115.534809:0:17067:0:(genops.c:1385:class_connect()) connect: client 6db0807f-6150-4b75-b37b-0ed71f62ed94, cookie 0x21b4d56138272a2d 00000100:00080000:0.0:1788846115.534821:0:17067:0:(import.c:510:import_select_connection()) MGC192.168.203.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846115.534833:0:17067:0:(import.c:624:import_select_connection()) MGC192.168.203.120@tcp: import ffff90e450e6a800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846115.534864:0:17067:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b3800 x1875740702439296/t0(0) o250->MGC192.168.203.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846115.534892:0:17067:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6db0807f-6150-4b75-b37b-0ed71f62ed94->MGS 00000020:01000004:0.0:1788846115.534913:0:17067:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788846115.534918:0:17067:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788846115.534930:0:17067:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90e34387b370) 00000020:00000080:0.0:1788846115.534941:0:17067:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788846115.535472:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6db0807f-6150-4b75-b37b-0ed71f62ed94:3639:1875740702439296:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788846115.535557:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.535633:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702439296 00000100:00100000:3.0:1788846115.535640:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702439296 00000100:00100000:3.0:1788846115.535664:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846115.535670:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3639:x1875740702439296:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788846115.535690:0:17080:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6db0807f-6150-4b75-b37b-0ed71f62ed94@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1788846115.535709:0:17080:0:(genops.c:1385:class_connect()) connect: client 6db0807f-6150-4b75-b37b-0ed71f62ed94, cookie 0x21b4d56138272a3b 00000100:00080000:3.0:1788846115.535815:0:17080:0:(import.c:65:import_set_state_nolock()) ffff90e343778000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846115.535862:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+5:3639:x1875740702439296:12345-0@lo:250:mount.lustre.0 Request processed in 191us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.535869:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846115.535898:0:3639:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788846115.535905:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.120@tcp: connect to target with instance 0 00000100:00080000:3.0:1788846115.535911:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788846115.535920:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788846115.535923:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e450e6a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788846115.535926:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788846115.535932:0:3639:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788846115.535936:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6db0807f-6150-4b75-b37b-0ed71f62ed94:3639:1875740702439296:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788846115.548998:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846115.549179:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788846115.549185:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788846115.549913:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788846115.549921:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788846115.550256:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788846115.550263:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788846115.554475:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846115.554826:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788846115.554832:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788846115.555185:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788846115.555191:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788846115.596034:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846115.596245:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788846115.596250:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788846115.601574:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788846115.601594:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788846115.602955:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846115.603133:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788846115.603138:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788846115.603771:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788846115.603778:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788846115.604442:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788846115.604631:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788846115.604637:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788846115.605115:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788846115.605123:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788846115.605712:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788846115.605861:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788846115.605866:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788846115.606461:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788846115.606468:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788846115.642249:0:17067:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846115.645253:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788846115.645273:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788846115.648785:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788846115.653060:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788846115.653958:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788846115.653967:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788846115.662788:0:17067:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788846115.662825:0:17067:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788846115.662831:0:17067:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788846115.662935:0:17067:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788846115.662978:0:17067:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788846115.662982:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788846115.662984:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846115.662985:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846115.662986:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846115.662987:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846115.662988:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846115.662990:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846115.662991:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846115.662993:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846115.662999:0:17067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788846115.663001:0:17067:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788846115.663003:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788846115.663004:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846115.663005:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846115.663006:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846115.663007:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846115.663008:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846115.663008:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846115.663009:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846115.663010:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846115.663011:0:17067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788846115.663038:0:17067:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788846115.663058:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439424:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788846115.663123:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846115.663177:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.663289:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702439424 00000100:00100000:3.0:1788846115.663297:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702439424 00000100:00100000:3.0:1788846115.663355:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846115.663365:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+5:17067:x1875740702439424:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788846115.663422:0:17083:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788846115.663425:0:17083:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788846115.663428:0:17083:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788846115.663750:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788846115.664317:0:17083:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788846115.671951:0:17105:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788846115.671960:0:17105:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788846115.671963:0:17105:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788846115.671966:0:17105:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788846115.672266:0:17105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788846115.673538:0:17083:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788846115.673551:0:17083:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788846115.676142:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+5:17067:x1875740702439424:12345-0@lo:253:mount.lustre.0 Request processed in 12770us (13010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.676156:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846115.676263:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788846115.676277:0:17067:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788846115.676281:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788846115.676283:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788846115.676284:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846115.676286:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846115.676287:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846115.676288:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846115.676290:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788846115.676292:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788846115.676293:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846115.676294:0:17067:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788846115.676311:0:17067:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e344550800 from lustre-MDT0000 10000000:01000000:0.0:1788846115.676349:0:17067:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788846115.676352:0:17067:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788846115.676356:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90e34265b370 10000000:01000000:0.0:1788846115.676366:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788846115.676373:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90e34265b370 from 1 10000000:01000000:0.0:1788846115.676376:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788846115.676420:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846115.676440:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846115.676452:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846115.676472:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846115.676516:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846115.676674:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4502fc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.681878:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702439552 00000100:00100000:3.0:1788846115.681895:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702439552 00000100:00100000:1.0:1788846115.682116:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846115.682126:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+5:17067:x1875740702439552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846115.682142:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846115.682163:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3600/0x21b4d56138272a49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272a42 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.682191:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3600/0x21b4d56138272a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272a42 expref: 6 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.682202:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e3600/0x21b4d56138272a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272a42 expref: 6 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.682211:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3600, rc 0) 00000100:00100000:1.0:1788846115.682291:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+6:17067:x1875740702439552:12345-0@lo:101:mount.lustre.0 Request processed in 166us (5773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846115.682298:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846115.682673:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846115.682708:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.682718:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.682793:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846115.682829:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.682906:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4453e10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846115.686760:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702439680 00000100:00100000:2.0:1788846115.686775:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702439680 00000100:00100000:2.0:1788846115.686841:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788846115.686851:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+6:17067:x1875740702439680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846115.686990:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+6:17067:x1875740702439680:12345-0@lo:501:mount.lustre.0 Request processed in 140us (4159us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788846115.687016:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846115.687646:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439680:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788846115.687687:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788846115.687707:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.687717:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846115.687726:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e344550800 10000000:01000000:3.0:1788846115.687731:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788846115.687736:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90e344550800 10000000:01000000:3.0:1788846115.687738:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788846115.687741:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90e344550800 from 1 10000000:01000000:3.0:1788846115.687743:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788846115.687774:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.687782:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.687804:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.687824:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846115.687863:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.687894:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4453e10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846115.687969:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702439808 00000100:00100000:1.0:1788846115.687974:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702439808 00000100:00100000:1.0:1788846115.688013:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846115.688021:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+6:17067:x1875740702439808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846115.688030:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846115.688047:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3400/0x21b4d56138272a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272a50 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.688066:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3400/0x21b4d56138272a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272a50 expref: 7 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.688076:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e3400/0x21b4d56138272a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272a50 expref: 7 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.688084:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3400, rc 0) 00000100:00100000:1.0:1788846115.688115:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+7:17067:x1875740702439808:12345-0@lo:101:mount.lustre.0 Request processed in 96us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846115.688121:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846115.688304:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846115.688316:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.688325:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846115.688349:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788846115.688369:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.688375:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475065200/0x21b4d56138272a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a57 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846115.688381:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788846115.688384:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846115.688402:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90e344550800 10000000:01000000:3.0:1788846115.688406:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788846115.688409:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788846115.688411:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788846115.688425:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.688439:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.688446:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.688459:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846115.688483:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.688510:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4453e10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846115.688688:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702439936 00000100:00100000:1.0:1788846115.688693:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702439936 00000100:00100000:1.0:1788846115.688721:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788846115.688728:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+7:17067:x1875740702439936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846115.688735:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846115.688744:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138272a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272a5e expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.688756:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138272a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272a5e expref: 8 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.688765:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2e00/0x21b4d56138272a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272a5e expref: 8 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.688771:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2e00, rc 0) 00000100:00100000:1.0:1788846115.688799:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+8:17067:x1875740702439936:12345-0@lo:101:mount.lustre.0 Request processed in 72us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846115.688813:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846115.689049:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702439936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846115.689060:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.689068:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.689114:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702440064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846115.689143:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.689169:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4453e10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846115.689220:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702440064 00000100:00100000:1.0:1788846115.689224:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702440064 00000100:00100000:1.0:1788846115.689253:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788846115.689259:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+8:17067:x1875740702440064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846115.689408:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+9:17067:x1875740702440064:12345-0@lo:501:mount.lustre.0 Request processed in 148us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846115.689415:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846115.689620:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702440064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846115.689648:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702440192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846115.689689:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846115.689705:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469a719c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846115.689753:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702440192 00000100:00100000:1.0:1788846115.689758:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702440192 00000100:00100000:1.0:1788846115.689777:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846115.689783:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+9:17067:x1875740702440192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846115.690684:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+9:17067:x1875740702440192:12345-0@lo:503:mount.lustre.0 Request processed in 897us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846115.690693:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846115.690823:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702440192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846115.691840:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17106:1875740702440320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846115.691899:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846115.691934:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469a71a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.691981:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702440320 00000100:00100000:3.0:1788846115.691988:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702440320 00000100:00100000:3.0:1788846115.692030:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788846115.692039:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+9:17106:x1875740702440320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.693777:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+9:17106:x1875740702440320:12345-0@lo:502:llog_process_th.0 Request processed in 1732us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.693789:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846115.693910:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17106:1875740702440320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788846115.693947:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846115.693958:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846115.693960:0:17106:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788846115.693964:0:17106:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788846115.693967:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788846115.693982:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90e4752e8000) 00000020:00000080:2.0:1788846115.693998:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788846115.694003:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788846115.694093:0:17106:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788846115.694101:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138272a73 00000020:00000080:2.0:1788846115.694292:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788846115.694297:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846115.694301:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846115.694303:0:17106:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788846115.694305:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846115.694308:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846115.694316:0:17106:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788846115.694321:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788846115.694329:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90e4752ecd28) 00000020:00000080:2.0:1788846115.694338:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788846115.694342:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788846115.694343:0:17106:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788846115.694346:0:17106:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788846115.694351:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788846115.694402:0:17106:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e344550800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788846115.694414:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90e4752e99b8) 00000020:00000080:2.0:1788846115.694422:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788846115.694471:0:17106:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788846115.694476:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138272a88 00000020:00000080:2.0:1788846115.694753:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788846115.694760:0:17106:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788846115.694765:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x21b4d56138272a8f 00080000:01000000:2.0:1788846115.694770:0:17106:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788846115.694773:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138272a96 00010000:00010000:3.0:1788846115.794383:0:17106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788846115.795189:0:17106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1788846115.796179:0:17106:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788846115.796867:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90e341e50000) 00000020:00000080:3.0:1788846115.796885:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788846115.798306:0:17106:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788846115.798329:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138272aa4 00000020:00000080:0.0:1788846115.800085:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788846115.807203:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x21b4d56138272aab 00000020:00000080:0.0:1788846115.807661:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788846115.807675:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846115.807681:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.807683:0:17106:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788846115.807686:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788846115.807689:0:17106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788846115.807691:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846115.807692:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846115.807693:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788846115.807696:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.807698:0:17106:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788846115.807700:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846115.807705:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.807706:0:17106:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788846115.807710:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788846115.807749:0:17106:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788846115.807763:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846115.807766:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.807773:0:17106:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788846115.807777:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846115.807781:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.807782:0:17106:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788846115.807784:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788846115.807789:0:17106:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:0.0:1788846115.807814:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788846115.807828:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90e3438799b8) 00000020:00000080:0.0:1788846115.807840:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788846115.807844:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788846115.807894:0:17106:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788846115.808074:0:17106:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788846115.808082:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138272ab9 00010000:00080000:0.0:1788846115.808113:0:17106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e451763800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846115.810850:0:17106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788846115.811950:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788846115.811963:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788846115.811996:0:17106:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788846115.812014:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138272ac0 00000100:00080000:3.0:1788846115.812025:0:17106:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788846115.812030:0:17106:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e451763800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846115.812062:0:17106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ed880 x1875740702440448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788846115.812090:0:17106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788846115.812149:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846115.812153:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846115.812155:0:17106:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788846115.812158:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788846115.812161:0:17106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788846115.812162:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788846115.812164:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788846115.812166:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788846115.812168:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846115.812170:0:17106:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788846115.812172:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788846115.812177:0:17106:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788846115.812180:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846115.812182:0:17106:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788846115.812185:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788846115.812189:0:17106:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:3.0:1788846115.812210:0:17106:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788846115.812217:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788846115.812228:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90e341e53370) 00000020:00000080:3.0:1788846115.812364:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788846115.812371:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788846115.812447:0:17106:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788846115.812453:0:17106:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788846115.812459:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138272ace 00010000:00080000:3.0:1788846115.812506:0:17106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e44314f800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1788846115.812723:0:17106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788846115.813007:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702440448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788846115.813072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846115.815185:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702440448 00000100:00100000:0.0:1788846115.815199:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702440448 00000100:00100000:0.0:1788846115.815295:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846115.815305:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702440448:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788846115.815323:0:17093:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788846115.820212:0:17106:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788846115.821090:0:17106:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788846115.827126:0:17106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846115.827777:0:17106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788846115.837293:0:17106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788846115.837881:0:17112:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788846115.837886:0:17112:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788846115.838449:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788846115.838460:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788846115.838492:0:17106:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788846115.838508:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138272ad5 00000100:00080000:1.0:1788846115.838517:0:17106:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846115.838544:0:17106:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e44314f800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846115.838576:0:17106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344577800 x1875740702440576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846115.838642:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702440576:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788846115.838689:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702440576 offset 0 length 520: 4 00000100:00080000:1.0:1788846115.838738:0:17106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788846115.838788:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788846115.838792:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846115.838794:0:17106:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788846115.838796:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788846115.838799:0:17106:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788846115.838800:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788846115.838802:0:17106:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788846115.838804:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788846115.838806:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846115.838807:0:17106:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788846115.838809:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788846115.838813:0:17106:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788846115.838816:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846115.838817:0:17106:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788846115.838819:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788846115.838822:0:17106:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:1.0:1788846115.838841:0:17106:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788846115.838844:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846115.838854:0:17106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90e342658000) 00000020:00000080:1.0:1788846115.838866:0:17106:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788846115.838871:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788846115.838921:0:17106:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788846115.838927:0:17106:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788846115.838933:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x21b4d56138272ae3 00010000:00080000:1.0:1788846115.838958:0:17106:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e47f491000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788846115.839149:0:17106:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788846115.839203:0:17106:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788846115.839215:0:17106:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788846115.843953:0:17106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788846115.844155:0:17106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788846115.844281:0:17106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788846115.845809:0:17114:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788846115.845815:0:17114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788846115.847641:0:17106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788846115.847654:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788846115.847692:0:17106:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788846115.847711:0:17106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138272aea 00000100:00080000:3.0:1788846115.847721:0:17106:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788846115.847727:0:17106:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e47f491000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846115.847760:0:17106:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ee680 x1875740702440704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846115.847819:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702440704:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788846115.847946:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702440704 offset 0 length 520: 4 00000100:00080000:3.0:1788846115.848493:0:17106:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788846115.848577:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846115.848584:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846115.848585:0:17106:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788846115.848588:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846115.848592:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846115.848594:0:17106:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788846115.848597:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788846115.848599:0:17106:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788846115.848601:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846115.848611:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846115.848612:0:17106:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788846115.848616:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846115.848618:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846115.848620:0:17106:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788846115.848623:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788846115.848652:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17106:1875740702440832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.848698:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.848727:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702440832 00000100:00100000:3.0:1788846115.848733:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702440832 00000100:00100000:3.0:1788846115.848776:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788846115.848784:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+9:17106:x1875740702440832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.848888:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+9:17106:x1875740702440832:12345-0@lo:502:llog_process_th.0 Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.848896:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788846115.848936:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.848953:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17106:1875740702440832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788846115.848978:0:17106:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846115.848982:0:17106:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846115.848984:0:17106:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788846115.848987:0:17106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788846115.849061:0:17067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788846115.849080:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788846115.849093:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.849104:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064000/0x21b4d56138272a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a65 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846115.849120:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e344550800 from 1 10000000:01000000:3.0:1788846115.849123:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788846115.849144:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.849153:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.849162:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.849174:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702440960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846115.849199:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.849213:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.849233:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702440960 00000100:00100000:3.0:1788846115.849237:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702440960 00000100:00100000:3.0:1788846115.849256:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788846115.849262:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+9:17067:x1875740702440960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846115.849271:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846115.849284:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272af1 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.849303:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272af1 expref: 10 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.849314:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272af1 expref: 10 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.849345:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065400, rc 0) 00000100:00100000:1.0:1788846115.850062:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702440448:12345-0@lo:38:llog_process_th.0 Request processed in 34754us (36986us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788846115.850077:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788846115.850217:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846115.850223:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846115.850227:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702440448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788846115.850496:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702440960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846115.850547:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846115.850558:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.850997:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+10:17067:x1875740702440960:12345-0@lo:101:mount.lustre.0 Request processed in 1732us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.851004:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846115.851196:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441088:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788846115.851301:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846115.851330:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442b91a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846115.851355:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702441088 00000100:00100000:0.0:1788846115.851361:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702441088 00000100:00100000:0.0:1788846115.851575:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846115.851584:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+10:17067:x1875740702441088:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788846115.851601:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788846115.851606:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788846115.851675:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+10:17067:x1875740702441088:12345-0@lo:256:mount.lustre.0 Request processed in 92us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846115.851682:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846115.851734:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441088:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788846115.853262:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788846115.853288:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846115.853300:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846115.853710:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e344550800 from 1 10000000:01000000:2.0:1788846115.853714:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846115.853753:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.853762:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.853772:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846115.853791:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846115.853878:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846115.853906:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.854085:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702441216 00000100:00100000:3.0:1788846115.854092:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702441216 00000100:00100000:3.0:1788846115.854145:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846115.854153:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+10:17067:x1875740702441216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846115.854165:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846115.854178:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272aff expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.854200:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272aff expref: 11 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.854210:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272aff expref: 11 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.854218:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065600, rc 0) 00000100:00100000:3.0:1788846115.854385:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17067:x1875740702441216:12345-0@lo:101:mount.lustre.0 Request processed in 232us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.854401:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846115.854698:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846115.854715:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.854722:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846115.854780:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846115.854819:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846115.854837:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846115.854885:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702441344 00000100:00100000:0.0:1788846115.854970:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702441344 00000100:00100000:0.0:1788846115.855008:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788846115.855016:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17067:x1875740702441344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846115.855144:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17067:x1875740702441344:12345-0@lo:501:mount.lustre.0 Request processed in 128us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846115.855151:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846115.855257:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846115.855296:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846115.855656:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846115.855674:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846115.855719:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702441472 00000100:00100000:0.0:1788846115.855723:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702441472 00000100:00100000:0.0:1788846115.855754:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788846115.855761:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17067:x1875740702441472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846115.856013:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17067:x1875740702441472:12345-0@lo:503:mount.lustre.0 Request processed in 251us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846115.856021:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846115.856089:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846115.856645:0:17116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17116:1875740702441600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788846115.856686:0:17116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846115.856741:0:17116:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4453fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846115.856773:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702441600 00000100:00100000:2.0:1788846115.856777:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702441600 00000100:00100000:2.0:1788846115.856859:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788846115.856867:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17116:x1875740702441600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788846115.858042:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17116:x1875740702441600:12345-0@lo:502:llog_process_th.0 Request processed in 1171us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846115.858052:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846115.858129:0:17116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17116:1875740702441600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788846115.858163:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846115.858172:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.858175:0:17116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788846115.858181:0:17116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e344550800 00000020:00000080:0.0:1788846115.858184:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846115.858191:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846115.858194:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.858195:0:17116:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788846115.858197:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846115.858199:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.858200:0:17116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788846115.858211:0:17116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e344550800 00000020:00000080:0.0:1788846115.858213:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846115.858300:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846115.858304:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.858305:0:17116:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788846115.858308:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846115.858311:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.858312:0:17116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846115.858321:0:17116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e344550800 00000020:00000080:0.0:1788846115.858323:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846115.858999:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846115.859006:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.859008:0:17116:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846115.859010:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846115.859013:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846115.859015:0:17116:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788846115.859019:0:17116:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e344550800 00000020:00000080:0.0:1788846115.859021:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788846115.859075:0:17116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17116:1875740702441728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788846115.859129:0:17116:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846115.859171:0:17116:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.861788:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702441728 00000100:00100000:3.0:1788846115.861799:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702441728 00000100:00100000:3.0:1788846115.861861:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788846115.861871:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17116:x1875740702441728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.862033:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17116:x1875740702441728:12345-0@lo:502:llog_process_th.0 Request processed in 163us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.862052:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788846115.862946:0:17116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17116:1875740702441728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788846115.862988:0:17116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788846115.862996:0:17116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846115.862998:0:17116:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788846115.863002:0:17116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788846115.863203:0:17067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788846115.863222:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788846115.863238:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.863248:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846115.863296:0:17067:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788846115.863299:0:17067:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e344550800 10000000:01000000:3.0:1788846115.863302:0:17067:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e344550800 10000000:01000000:3.0:1788846115.863306:0:17067:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846115.863311:0:17067:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e344550800 from 1 10000000:01000000:3.0:1788846115.863329:0:17067:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788846115.863359:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.863368:0:17067:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.863378:0:17067:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.863405:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846115.863461:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.863501:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.867082:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702441856 00000100:00100000:3.0:1788846115.867096:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702441856 00000100:00100000:3.0:1788846115.867153:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846115.867163:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17067:x1875740702441856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846115.867178:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846115.867195:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064200/0x21b4d56138272b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272b0d expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.867220:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064200/0x21b4d56138272b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272b0d expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.867231:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064200/0x21b4d56138272b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272b0d expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.867239:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064200, rc 0) 00000100:00100000:3.0:1788846115.867309:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17067:x1875740702441856:12345-0@lo:101:mount.lustre.0 Request processed in 148us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.867328:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846115.867397:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846115.867415:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.867424:0:17067:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.867512:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846115.867564:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.867591:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.867607:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702441984 00000100:00100000:3.0:1788846115.867611:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702441984 00000100:00100000:3.0:1788846115.867638:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846115.867644:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17067:x1875740702441984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846115.867750:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17067:x1875740702441984:12345-0@lo:501:mount.lustre.0 Request processed in 105us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.867757:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846115.867786:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702441984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846115.867810:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702442112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846115.867844:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.867857:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.867869:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702442112 00000100:00100000:3.0:1788846115.867872:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702442112 00000100:00100000:3.0:1788846115.867893:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788846115.867899:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17067:x1875740702442112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846115.867969:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17067:x1875740702442112:12345-0@lo:503:mount.lustre.0 Request processed in 69us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.867975:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788846115.868016:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702442112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846115.868195:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17119:1875740702442240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.868225:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.868243:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702442240 00000100:00100000:3.0:1788846115.868246:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702442240 00000100:00100000:3.0:1788846115.868267:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788846115.868272:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17119:x1875740702442240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.868341:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17119:x1875740702442240:12345-0@lo:502:llog_process_th.0 Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.868353:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788846115.868384:0:17119:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.868411:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17119:1875740702442240:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788846115.868462:0:17119:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788846115.868475:0:17119:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90e341e519b8) 00000020:00000080:3.0:1788846115.868495:0:17119:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788846115.868595:0:17119:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e344550800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788846115.868599:0:17119:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e344550800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788846115.868602:0:17119:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e344550800 4 00010000:00080000:3.0:1788846115.868626:0:17119:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e47b581800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.120@tcp at head 00010000:00010000:3.0:1788846115.870172:0:17119:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788846115.870350:0:17119:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788846115.870384:0:17119:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788846115.875689:0:17119:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x21b4d56138272b22 00000100:00080000:3.0:1788846115.875705:0:17119:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788846115.875712:0:17119:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90e47b581800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846115.875746:0:17119:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ef480 x1875740702442368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846115.875791:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702442368:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788846115.875860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788846115.875918:0:17119:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788846115.876318:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702442368 00000100:00100000:0.0:1788846115.876326:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702442368 00000100:00100000:0.0:1788846115.876501:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846115.876509:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702442368:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788846115.876585:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702442368:12345-0@lo:38:llog_process_th.0 Request processed in 74us (724us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788846115.876591:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846115.876776:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788846115.876784:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47b581800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846115.876788:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788846115.876791:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702442368:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788846115.877779:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17119:1875740702442496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.877835:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.877865:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702442496 00000100:00100000:3.0:1788846115.877871:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702442496 00000100:00100000:3.0:1788846115.877902:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788846115.877910:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17119:x1875740702442496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.878014:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17119:x1875740702442496:12345-0@lo:502:llog_process_th.0 Request processed in 104us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.878021:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788846115.878065:0:17119:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e46056a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.878081:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17119:1875740702442496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.878117:0:17119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17119:1875740702442624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.878144:0:17119:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.878161:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702442624 00000100:00100000:3.0:1788846115.878164:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702442624 00000100:00100000:3.0:1788846115.878181:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788846115.878186:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17119:x1875740702442624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788846115.878239:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17119:x1875740702442624:12345-0@lo:502:llog_process_th.0 Request processed in 52us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.878246:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788846115.878273:0:17119:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3410820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.878285:0:17119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6db0807f-6150-4b75-b37b-0ed71f62ed94:17119:1875740702442624:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788846115.878301:0:17119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788846115.878367:0:17067:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788846115.878405:0:17067:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788846115.878419:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.878438:0:17067:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064600/0x21b4d56138272b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b14 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788846115.878485:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788846115.878487:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788846115.878488:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846115.878490:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846115.878491:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846115.878492:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846115.878493:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788846115.878495:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788846115.878497:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846115.878498:0:17067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788846115.878502:0:17067:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788846115.878504:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788846115.878505:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788846115.878506:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846115.878508:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846115.878509:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846115.878510:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846115.878511:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788846115.878512:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788846115.878513:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846115.878514:0:17067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788846115.878543:0:17067:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788846115.878551:0:17067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702442752:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788846115.878576:0:17067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846115.878588:0:17067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3410820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.878606:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702442752 00000100:00100000:3.0:1788846115.878609:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702442752 00000100:00100000:3.0:1788846115.878627:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788846115.878632:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17067:x1875740702442752:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788846115.878655:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788846115.878719:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788846115.887623:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788846115.887643:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788846115.888278:0:17104:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788846115.888284:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788846115.888307:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.888326:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272af1 expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.888334:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.888384:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272af1 expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846115.888407:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272af1 expref: 12 pid: 17083 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846115.888420:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702442880:0@lo:104: 00000100:00100000:1.0:1788846115.888483:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846115.888562:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846115.888590:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702442880 00000100:00100000:3.0:1788846115.888598:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702442880 00000100:00100000:3.0:1788846115.888643:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846115.888652:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:17104:x1875740702442880:12345-0@lo:104: 00010000:00010000:3.0:1788846115.888664:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846115.888748:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846115.888754:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:17104:x1875740702442880:12345-0@lo:104: Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.888761:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788846115.888769:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702442880:0@lo:104: 00010000:00010000:1.0:1788846115.888788:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846115.888818:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17067:x1875740702442752:12345-0@lo:253:mount.lustre.0 Request processed in 10184us (10240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846115.888825:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788846115.888867:0:17067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17067:1875740702442752:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788846115.888876:0:17067:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788846115.888879:0:17067:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788846115.888880:0:17067:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788846115.888882:0:17067:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846115.888883:0:17067:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846115.888884:0:17067:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846115.888885:0:17067:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846115.888886:0:17067:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788846115.888888:0:17067:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788846115.888889:0:17067:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846115.888890:0:17067:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788846115.888901:0:17067:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788846115.889130:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846115.889142:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.889149:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846115.889152:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.889160:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846115.889167:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846115.889173:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788846115.889200:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.889206:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846115.889225:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.889232:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272af8 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.889247:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846115.889249:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846115.889250:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846115.889277:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702443008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846115.889308:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846115.889353:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702443008 00000100:00100000:2.0:1788846115.891009:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702443008 00010000:00010000:2.0:1788846115.891044:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272af1 expref: 12 pid: 17083 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846115.891131:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846115.891140:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:3641:x1875740702443008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846115.891152:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846115.891157:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272af1 expref: 12 pid: 17083 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891168:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272af1 expref: 12 pid: 17083 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891185:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065400/0x21b4d56138272af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272af1 expref: 12 pid: 17083 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891200:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891208:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788846115.891224:0:17073:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002940532s 00010000:00010000:2.0:1788846115.891228:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891235:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891242:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891258:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891264:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846115.891268:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891276:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891291:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.891301:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846115.892456:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:3641:x1875740702443008:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846115.892466:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846115.894787:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702443008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846115.894819:0:17104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.894856:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846115.894863:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272b29 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788846115.918020:0:17067:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788846115.918512:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788846115.919122:0:17129:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788846115.919454:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788846115.919739:0:17129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788846115.920713:0:17128:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788846115.920719:0:17128:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1788846115.926153:0:17129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788846115.926231:0:17129:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1788846115.926915:0:17130:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff90e343a3aa00 x1875740702443136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846115.926927:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00000040:01000000:3.0:1788846115.927592:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788846115.927706:0:17067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788846115.928296:0:17067:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788846115.928306:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788846115.928782:0:17067:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846115.931145:0:17067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788846115.934116:0:17067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788846115.934196:0:17067:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788846115.938044:0:17067:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788846115.940449:0:17067:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788846115.942812:0:17067:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788846115.943031:0:17067:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f081aa3988 00100000:10000000:3.0:1788846115.943039:0:17067:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788846115.945198:0:17067:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788846115.945213:0:17067:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788846115.945229:0:17067:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788846115.945242:0:17067:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788846115.948496:0:17067:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846115.949069:0:17067:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788846116.537891:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846116.925312:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846116.985868:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 10000000:01000000:0.0:1788846117.433614:0:17086:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846117.433621:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e344550800 from 7 10000000:01000000:0.0:1788846117.433626:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846117.433788:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846117.433801:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846117.433944:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846117.433973:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702443264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846117.434043:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846117.434265:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788846117.434735:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702443264 00000100:00100000:3.0:1788846117.434743:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702443264 00000100:00100000:3.0:1788846117.435201:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788846117.435214:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45356a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+11:17086:x1875740702443264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846117.435229:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846117.435246:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272b30 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846117.435272:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272b30 expref: 12 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846117.435284:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272b30 expref: 12 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846117.435303:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064c00, rc 0) 00000100:00100000:3.0:1788846117.435387:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45356a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17086:x1875740702443264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846117.435393:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846117.435554:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702443264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846117.435571:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846117.435580:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846117.435647:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702443392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788846117.435686:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846117.435717:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d1879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846117.436034:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702443392 00000100:00100000:3.0:1788846117.436041:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702443392 00000100:00100000:3.0:1788846117.436081:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788846117.436089:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e446729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17086:x1875740702443392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788846117.436105:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788846117.436122:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788846117.436125:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788846117.436206:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e446729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17086:x1875740702443392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846117.436213:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788846117.436244:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702443392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788846117.436319:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788846117.436327:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846117.436336:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846117.561866:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846117.946134:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846118.009639:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:3.0:1788846118.586653:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846119.035166:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:3.0:1788846119.609840:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846120.059724:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00000001:02000400:3.0:1788846120.229123:0:17373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788846120.635458:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846121.081750:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00000020:00000004:3.0:1788846121.175147:0:17425:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788846121.175455:0:17425:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1788846121.274675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788846121.274682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788846121.274686:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846121.274694:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:1.0:1788846121.274700:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788846121.274707:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e451763800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846121.274730:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846121.274733:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344577b80 x1875740702443648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846121.274746:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702443520:0@lo:400:kworker.0 00000100:00080000:1.0:1788846121.274754:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846121.274759:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846121.274762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846121.274765:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846121.274768:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788846121.274771:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788846121.274773:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e47b581800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846121.274779:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90e47b581800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846121.274793:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344577480 x1875740702443776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846121.274820:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702443648:0@lo:38:kworker.0 00000100:00100000:3.0:1788846121.274828:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846121.275567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846121.275615:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702443776:0@lo:38:kworker.0 00000100:00100000:1.0:1788846121.275678:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846121.276222:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702443776 00000100:00100000:0.0:1788846121.276232:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702443776 00000100:00100000:0.0:1788846121.276264:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846121.276272:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702443776:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788846121.276298:0:17090:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:0.0:1788846121.276335:0:17090:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x21b4d56138272b3e 00000004:00100000:0.0:1788846121.276361:0:17090:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788846121.276573:0:17090:0:(import.c:65:import_set_state_nolock()) ffff90e47518a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788846121.276637:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1875740702443776:12345-0@lo:38:kworker.0 Request processed in 364us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846121.276644:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846121.277373:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702443520 00000100:00100000:3.0:1788846121.277383:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702443520 00000100:00100000:3.0:1788846121.277420:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788846121.277428:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e446728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:3643:x1875740702443520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846121.277490:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e446728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:3643:x1875740702443520:12345-0@lo:400:kworker.0 Request processed in 63us (2663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846121.277497:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788846121.277564:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702443648 00000100:00100000:3.0:1788846121.277569:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702443648 00000100:00100000:3.0:1788846121.277585:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846121.277589:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702443648:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788846121.277605:0:17094:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788846121.277936:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702443520:0@lo:400:kworker.0 00010000:00080000:1.0:1788846121.280439:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90e344577480 x1875740702443776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788846121.280462:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788846121.280471:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788846121.280476:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788846121.280479:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47b581800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788846121.280487:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3639:1875740702443776:0@lo:38:kworker.0 00000100:00100000:3.0:1788846121.310630:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702443648:12345-0@lo:38:kworker.0 Request processed in 33031us (35057us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788846121.310645:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788846121.310811:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846121.310817:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846121.310822:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702443648:0@lo:38:kworker.0 00010000:00010000:2.0:1788846121.658313:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788846122.015746:0:17475:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788846122.015902:0:17475:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788846122.105656:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:3.0:1788846122.685855:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846123.130939:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:2.0:1788846123.707327:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846124.162097:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:3.0:1788846124.735572:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846125.177601:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00000100:00100000:1.0:1788846125.370725:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846115/real 1788846115] req@ffff90e47f4ee680 x1875740702440704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846125.370767:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e47f4ee680 x1875740702440704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846125.370779:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846115/real 1788846115] req@ffff90e344577800 x1875740702440576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846125 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846125.370793:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e344577800 x1875740702440576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846125 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788846125.370810:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846125.370836:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788846125.370839:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702440704:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788846125.370845:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788846125.370850:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788846125.370868:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702440576:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788846125.371045:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788846125.371049:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788846125.371052:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846125.371057:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:0.0:1788846125.371062:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788846125.371068:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e451763800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846125.371088:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b0e00 x1875740702444032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846125.371097:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846125.371099:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788846125.371100:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846125.371103:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:0.0:1788846125.371105:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788846125.371108:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e44314f800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846125.371115:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b3b80 x1875740702444160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846125.371122:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846125.371130:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788846125.371132:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846125.371134:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:0.0:1788846125.371137:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788846125.371139:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e47f491000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846125.371149:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b1880 x1875740702444288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846125.371189:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702444416:0@lo:400:kworker.0 00000100:00100000:0.0:1788846125.371254:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846125.371436:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846125.371447:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702443904:0@lo:400:kworker.0 00000100:00100000:3.0:1788846125.371482:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846125.371560:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702444416 00000100:00100000:3.0:1788846125.371567:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702444416 00000100:00100000:3.0:1788846125.371609:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846125.371619:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702444416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846125.371667:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702444416:12345-0@lo:400:kworker.0 Request processed in 49us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846125.371675:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788846125.371710:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90e47d3b2680 x1875740702444416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846125.371722:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702444416:0@lo:400:kworker.0 00000100:00100000:1.0:1788846125.372147:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702444032:0@lo:38:kworker.0 00000100:00100000:1.0:1788846125.372208:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846125.372237:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702444160:0@lo:8:kworker.0 00000400:00000100:1.0:1788846125.372260:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702444160 offset 0 length 520: 4 00000100:00100000:1.0:1788846125.372277:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702444288:0@lo:8:kworker.0 00000400:00000100:1.0:1788846125.372333:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702444288 offset 0 length 520: 4 00000100:00100000:2.0:1788846125.372466:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702444032 00000100:00100000:2.0:1788846125.372472:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702444032 00000100:00100000:2.0:1788846125.372507:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846125.372513:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702444032:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788846125.372557:0:17093:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846125.373371:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702443904 00000100:00100000:0.0:1788846125.373380:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702443904 00000100:00100000:0.0:1788846125.373431:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788846125.373439:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44672ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:3642:x1875740702443904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846125.373500:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44672ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:3642:x1875740702443904:12345-0@lo:400:kworker.0 Request processed in 63us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846125.373507:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788846125.373846:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702443904:0@lo:400:kworker.0 00000100:00100000:2.0:1788846125.395245:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1875740702444032:12345-0@lo:38:kworker.0 Request processed in 22723us (23027us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788846125.395260:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788846125.395409:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846125.396833:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788846125.396840:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702444032:0@lo:38:kworker.0 00010000:00010000:2.0:1788846125.764622:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846126.201724:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:3.0:1788846126.778745:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788846127.167207:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846127.227210:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:2.0:1788846127.801767:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846128.252176:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00000020:01000004:0.0:1788846128.571802:0:17820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788846128.571805:0:17820:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788846128.571807:0:17820:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788846128.571919:0:17820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e475188800 00000020:01000004:0.0:1788846128.571933:0:17820:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788846128.571943:0:17820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788846128.571960:0:17820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90e46d518000) 00000020:00000080:0.0:1788846128.571976:0:17820:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788846128.657990:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788846128.658853:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.659973:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788846128.660349:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788846128.660749:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788846128.661063:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788846128.661430:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788846128.661711:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788846128.661923:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788846128.662140:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788846128.662444:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788846128.662948:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788846128.663406:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788846128.663749:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788846128.665448:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.667191:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.667475:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.667883:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.668231:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.668490:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.668808:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.669017:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.669336:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.669586:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.669780:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.671248:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.671675:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.671962:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.672333:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.672559:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.673894:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.674237:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.674601:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.675683:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.676466:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.676753:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.677057:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.677365:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.677588:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.677898:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.678101:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.678471:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.678707:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788846128.679027:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.679666:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788846128.679953:0:17820:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00080000:01000000:2.0:1788846128.685355:0:17820:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788846128.685615:0:17820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788846128.685627:0:17820:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788846128.685638:0:17820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d56138272b4c 00000020:01000004:2.0:1788846128.685645:0:17820:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788846128.685665:0:17820:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788846128.685669:0:17820:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788846128.685674:0:17820:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788846128.685699:0:17820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788846128.685703:0:17820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788846128.692737:0:17820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788846128.692838:0:17820:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788846128.692844:0:17820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788846128.692845:0:17820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788846128.692847:0:17820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846128.692848:0:17820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846128.692849:0:17820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846128.692851:0:17820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846128.692852:0:17820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846128.692854:0:17820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846128.692855:0:17820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846128.692858:0:17820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788846128.692860:0:17820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788846128.692862:0:17820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788846128.692863:0:17820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846128.692864:0:17820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846128.692865:0:17820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846128.692871:0:17820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846128.692872:0:17820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846128.692873:0:17820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846128.692874:0:17820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846128.692908:0:17820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788846128.692928:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702444544:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788846128.693079:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.693267:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4751a8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788846128.693443:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702444544 00000100:00100000:3.0:1788846128.693450:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702444544 00000100:00100000:3.0:1788846128.693617:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788846128.693627:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44672a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17820:x1875740702444544:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788846128.693657:0:17082:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788846128.693660:0:17082:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788846128.693668:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788846128.694086:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44672a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17820:x1875740702444544:12345-0@lo:253:mount.lustre.0 Request processed in 460us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846128.694094:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788846128.694254:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702444544:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788846128.694265:0:17820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788846128.694277:0:17820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788846128.694279:0:17820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788846128.694280:0:17820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846128.694281:0:17820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846128.694282:0:17820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846128.694284:0:17820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846128.694285:0:17820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788846128.694287:0:17820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846128.694288:0:17820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788846128.694315:0:17820:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e475188800 from lustre-MDT0001 10000000:01000000:2.0:1788846128.694340:0:17820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788846128.694342:0:17820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788846128.694348:0:17820:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e34265b370 local copy 00010000:00010000:2.0:1788846128.694359:0:17820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846128.694446:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702444672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846128.694475:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.694508:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.694616:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702444672 00000100:00100000:0.0:1788846128.694621:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702444672 00000100:00100000:0.0:1788846128.694657:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788846128.694665:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17820:x1875740702444672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846128.694737:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17820:x1875740702444672:12345-0@lo:501:mount.lustre.0 Request processed in 72us (261us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788846128.694744:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788846128.694903:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702444672:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788846128.694917:0:17820:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788846128.694935:0:17820:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788846128.694953:0:17820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.694962:0:17820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846128.694990:0:17820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e475188800 10000000:01000000:2.0:1788846128.694995:0:17820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788846128.695000:0:17820:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90e34265b370 10000000:01000000:2.0:1788846128.695002:0:17820:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788846128.695006:0:17820:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90e34265b370 from 1 10000000:01000000:2.0:1788846128.695009:0:17820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788846128.695031:0:17820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.695038:0:17820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.695046:0:17820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846128.695059:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702444800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846128.695084:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846128.695197:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702444800 00000100:00100000:1.0:1788846128.695202:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702444800 00000100:00100000:1.0:1788846128.695228:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788846128.695233:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+12:17820:x1875740702444800:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846128.695241:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846128.695252:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138272b5a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272b53 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.695282:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138272b5a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272b53 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.695292:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2c00/0x21b4d56138272b5a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272b53 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.695310:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2c00, rc 0) 00000100:00100000:1.0:1788846128.695336:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+13:17820:x1875740702444800:12345-0@lo:101:mount.lustre.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846128.695353:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788846128.695455:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846128.695470:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702444800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846128.695481:0:17820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b5a expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.695489:0:17820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b5a expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846128.695509:0:17820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788846128.695551:0:17820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b5a expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.695558:0:17820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c400/0x21b4d56138272b53 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b5a expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846128.695564:0:17820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90e475188800 10000000:01000000:2.0:1788846128.695568:0:17820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788846128.695571:0:17820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90e475188800 from 1 10000000:01000000:2.0:1788846128.695573:0:17820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788846128.695588:0:17820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.695594:0:17820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.695601:0:17820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846128.695612:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702444928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846128.695636:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.695653:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846128.695733:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702444928 00000100:00100000:1.0:1788846128.695738:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702444928 00000100:00100000:1.0:1788846128.695768:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788846128.695842:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+13:17820:x1875740702444928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846128.695851:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846128.695859:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2800/0x21b4d56138272b68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272b61 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.695871:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2800/0x21b4d56138272b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272b61 expref: 14 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.695879:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2800/0x21b4d56138272b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272b61 expref: 14 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.695884:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2800, rc 0) 00000100:00100000:1.0:1788846128.695919:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+14:17820:x1875740702444928:12345-0@lo:101:mount.lustre.0 Request processed in 145us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846128.695925:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788846128.696024:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702444928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846128.696035:0:17820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.696042:0:17820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846128.696061:0:17820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788846128.696075:0:17820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.696082:0:17820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42d400/0x21b4d56138272b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b68 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846128.696088:0:17820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788846128.696092:0:17820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788846128.696096:0:17820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90e475188800 10000000:01000000:2.0:1788846128.696099:0:17820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788846128.696102:0:17820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788846128.696104:0:17820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788846128.696191:0:17820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.696198:0:17820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.696205:0:17820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846128.696216:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846128.696242:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.696263:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.696350:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702445056 00000100:00100000:0.0:1788846128.696355:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702445056 00000100:00100000:0.0:1788846128.696386:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788846128.696393:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+14:17820:x1875740702445056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846128.696400:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846128.696410:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441356e00/0x21b4d56138272b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272b6f expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846128.696423:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441356e00/0x21b4d56138272b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272b6f expref: 15 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846128.696443:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441356e00/0x21b4d56138272b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272b6f expref: 15 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846128.696451:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356e00, rc 0) 00000100:00100000:0.0:1788846128.696485:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445056:12345-0@lo:101:mount.lustre.0 Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.696491:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846128.696503:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846128.696514:0:17820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.696552:0:17820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846128.698241:0:17820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788846128.699254:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846128.703585:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788846128.703639:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788846128.703657:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788846128.703672:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788846128.703687:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1788846128.703699:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1788846128.703720:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1788846128.703734:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788846128.703746:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788846128.703757:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1788846128.703769:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1788846128.703936:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1788846128.703949:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1788846128.703961:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788846128.703975:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788846128.703987:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1788846128.703999:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788846128.704011:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788846128.704024:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1788846128.704038:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788846128.704052:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788846128.704065:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788846128.704077:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788846128.704104:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1788846128.704181:0:17820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1788846128.704345:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846128.704417:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.704508:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.704649:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702445184 00000100:00100000:0.0:1788846128.704656:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702445184 00000100:00100000:1.0:1788846128.704878:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788846128.704888:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846128.705074:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445184:12345-0@lo:501:mount.lustre.0 Request processed in 187us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846128.705082:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788846128.705264:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846128.705371:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846128.705411:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.705475:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.705506:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702445312 00000100:00100000:0.0:1788846128.705510:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702445312 00000100:00100000:0.0:1788846128.705690:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788846128.705698:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846128.707468:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445312:12345-0@lo:503:mount.lustre.0 Request processed in 1765us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.707479:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788846128.707619:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445312:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788846128.708086:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788846128.708165:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846128.708211:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.709801:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.709906:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702445440 00000100:00100000:0.0:1788846128.709915:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702445440 00000100:00100000:0.0:1788846128.710020:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788846128.710031:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846128.711288:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445440:12345-0@lo:502:mount.lustre.0 Request processed in 1253us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.711306:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788846128.711410:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846128.711711:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788846128.711739:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788846128.711754:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788846128.711764:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788846128.711775:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788846128.711968:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788846128.711990:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788846128.712004:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788846128.712035:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788846128.712174:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788846128.712191:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788846128.712201:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788846128.712213:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788846128.712226:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788846128.712240:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788846128.712264:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788846128.712278:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788846128.712291:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788846128.712314:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788846128.712329:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788846128.712342:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788846128.712357:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788846128.712371:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788846128.712385:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788846128.712412:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788846128.712427:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788846128.712629:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788846128.712645:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788846128.712659:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788846128.712672:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788846128.712686:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788846128.712700:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788846128.712714:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788846128.712728:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788846128.712743:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788846128.712756:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788846128.712769:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788846128.712781:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788846128.713197:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788846128.713212:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788846128.713241:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788846128.713255:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788846128.713269:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788846128.713283:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788846128.713333:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846128.713404:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846128.713614:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702445568 00000100:00100000:1.0:1788846128.713621:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702445568 00000100:00100000:1.0:1788846128.713669:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788846128.713683:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846128.713986:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702445568:12345-0@lo:502:mount.lustre.0 Request processed in 303us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846128.713993:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788846128.714264:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846128.714294:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702445568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846128.714357:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788846128.714367:0:17820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788846128.716312:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788846128.716325:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846128.716328:0:17824:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788846128.716334:0:17824:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788846128.716337:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846128.716352:0:17824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff90e34265cd28) 00000020:00000080:1.0:1788846128.716373:0:17824:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788846128.716378:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788846128.716503:0:17824:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788846128.716511:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d56138272b84 00000020:00000080:1.0:1788846128.719358:0:17824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788846128.719369:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788846128.719375:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846128.719377:0:17824:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788846128.719380:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788846128.719385:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788846128.719386:0:17824:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788846128.719390:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788846128.719401:0:17824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff90e3426599b8) 00000020:00000080:1.0:1788846128.719417:0:17824:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788846128.719420:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788846128.719422:0:17824:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788846128.719424:0:17824:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788846128.720183:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788846128.720252:0:17824:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e475188800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788846128.720278:0:17824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff90e474c7b370) 00000020:00000080:1.0:1788846128.720289:0:17824:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788846128.720383:0:17824:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788846128.720390:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138272b99 00000020:00000080:1.0:1788846128.721205:0:17824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788846128.721215:0:17824:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788846128.721222:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x21b4d56138272ba0 00080000:01000000:1.0:1788846128.721230:0:17824:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788846128.721233:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d56138272ba7 00010000:00010000:0.0:1788846128.813478:0:17824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788846128.814105:0:17824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788846128.814364:0:17824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788846128.815333:0:17824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788846128.815344:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846128.815350:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846128.815352:0:17824:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788846128.815355:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846128.815360:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846128.815361:0:17824:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788846128.815364:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788846128.815369:0:17824:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:00000080:0.0:1788846128.815394:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788846128.815406:0:17824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff90e46d5199b8) 00000020:00000080:0.0:1788846128.815425:0:17824:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788846128.815434:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788846128.815512:0:17824:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788846128.815556:0:17824:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788846128.815563:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d56138272bb5 00010000:00080000:0.0:1788846128.815600:0:17824:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e343be0000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846128.819508:0:17824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788846128.827939:0:17824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846128.827954:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788846128.828009:0:17824:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788846128.828031:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138272bbc 00000100:00080000:2.0:1788846128.828041:0:17824:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788846128.828048:0:17824:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90e343be0000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846128.828083:0:17824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e343a3b100 x1875740702445696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846128.828152:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702445696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788846128.828223:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788846128.828372:0:17824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788846128.828431:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846128.828436:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.828438:0:17824:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788846128.828441:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788846128.828444:0:17824:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788846128.828446:0:17824:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846128.828447:0:17824:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846128.828449:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788846128.828451:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.828453:0:17824:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788846128.828455:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846128.828460:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.828462:0:17824:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788846128.828466:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788846128.828499:0:17824:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788846128.828512:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846128.828515:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.828516:0:17824:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788846128.828553:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788846128.828567:0:17824:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788846128.828569:0:17824:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846128.828570:0:17824:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846128.828572:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788846128.828575:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.828576:0:17824:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788846128.828579:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788846128.828582:0:17824:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788846128.828585:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.828586:0:17824:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788846128.828590:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788846128.828593:0:17824:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1788846128.828612:0:17824:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788846128.828616:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788846128.828627:0:17824:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90e4752eb370) 00000020:00000080:2.0:1788846128.828640:0:17824:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788846128.828644:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788846128.828699:0:17824:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788846128.828706:0:17824:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788846128.828711:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d56138272bca 00010000:00080000:2.0:1788846128.828738:0:17824:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e44314c000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1788846128.828941:0:17824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1788846128.829289:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702445696 00000100:00100000:1.0:1788846128.829297:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702445696 00000100:00100000:1.0:1788846128.829342:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846128.829349:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702445696:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846128.829371:0:17094:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1788846128.829396:0:17094:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138272bd1 00000004:00100000:1.0:1788846128.829410:0:17094:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788846128.829415:0:17094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788846128.829940:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788846128.829945:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788846128.829948:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846128.829953:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:2.0:1788846128.830093:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788846128.830101:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e451763800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846128.830126:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e343a39500 x1875740702445824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1788846128.830266:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846128.830389:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702445824:0@lo:38:kworker.0 00000100:00100000:0.0:1788846128.830443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788846128.832186:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846128.832194:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846128.832197:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846128.832200:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846128.832254:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702445952:0@lo:400:kworker.0 00000040:01000000:0.0:1788846128.832457:0:17824:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788846128.832812:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.833110:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702445952 00000100:00100000:0.0:1788846128.833118:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702445952 00000100:00100000:0.0:1788846128.833163:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788846128.833172:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702445952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846128.833225:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875740702445952:12345-0@lo:400:kworker.0 Request processed in 54us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.833231:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788846128.833400:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e343a39f80 x1875740702445952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846128.833414:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875740702445952:0@lo:400:kworker.0 00000040:01000000:2.0:1788846128.833445:0:17824:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788846128.834154:0:17093:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788846128.834406:0:17093:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788846128.835096:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702445824 00000100:00100000:3.0:1788846128.835103:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702445824 00000100:00100000:0.0:1788846128.835469:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846128.835476:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875740702445824:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788846128.835567:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3639:x1875740702445824:12345-0@lo:38:kworker.0 Request processed in 91us (5123us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788846128.835574:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846128.835604:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788846128.835611:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846128.835615:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788846128.835618:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702445824:0@lo:38:kworker.0 00000040:00080000:2.0:1788846128.835818:0:17824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846128.836776:0:17824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788846128.836911:0:17824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788846128.837734:0:17830:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788846128.837738:0:17830:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:3.0:1788846128.838119:0:17094:0:(import.c:65:import_set_state_nolock()) ffff90e47b580800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846128.838247:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702445696:12345-0@lo:38:llog_process_th.0 Request processed in 8896us (10022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846128.838258:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:00000080:2.0:1788846128.838891:0:17824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846128.838902:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788846128.838938:0:17824:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788846128.838956:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138272bd8 00000100:00080000:2.0:1788846128.839187:0:17824:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788846128.839193:0:17824:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90e44314c000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846128.839219:0:17824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e343a39f80 x1875740702446080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846128.839234:0:17824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788846128.839353:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846128.839357:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.839359:0:17824:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788846128.839361:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788846128.839364:0:17824:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788846128.839366:0:17824:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846128.839367:0:17824:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788846128.839368:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788846128.839371:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.839372:0:17824:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788846128.839374:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788846128.839378:0:17824:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788846128.839380:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.839382:0:17824:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788846128.839384:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788846128.839387:0:17824:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.120@tcp to nid 0x20000c0a8cb78 (192.168.203.120@tcp) 00000020:01000000:2.0:1788846128.839407:0:17824:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788846128.839410:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788846128.839420:0:17824:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90e47b68b370) 00000020:00000080:2.0:1788846128.839432:0:17824:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788846128.839436:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788846128.839497:0:17824:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788846128.839503:0:17824:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788846128.839507:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x21b4d56138272be6 00010000:00080000:2.0:1788846128.839556:0:17824:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e446110000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:2.0:1788846128.839743:0:17824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788846128.839806:0:17824:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788846128.839820:0:17824:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788846128.840845:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788846128.840857:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788846128.840864:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788846128.840870:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788846128.840874:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e343be0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788846128.840893:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702445696:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788846128.841104:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702446208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846128.841164:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.841228:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702446208 00000100:00100000:0.0:1788846128.841234:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702446208 00000100:00100000:0.0:1788846128.841277:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846128.841286:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875740702446208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846128.841323:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000040:00080000:2.0:1788846128.842283:0:17824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846128.842556:0:17824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788846128.842661:0:17824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788846128.842937:0:17832:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788846128.842944:0:17832:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1788846128.843184:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702446080:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788846128.843227:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702446080 offset 0 length 520: 4 00000100:00080000:3.0:1788846128.843260:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846128.843264:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846128.843282:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846128.843285:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:2.0:1788846128.843875:0:17824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788846128.843886:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788846128.843921:0:17824:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788846128.843939:0:17824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138272bed 00000100:00080000:2.0:1788846128.843946:0:17824:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788846128.843951:0:17824:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e446110000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846128.844107:0:17824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e343a3b480 x1875740702446336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788846128.844158:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702446336:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788846128.844186:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702446336 offset 0 length 520: 4 00000100:00100000:0.0:1788846128.844266:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3642:x1875740702446208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2979us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.844284:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788846128.844400:0:17824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788846128.844460:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846128.844464:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.844466:0:17824:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788846128.844469:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846128.844473:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.844474:0:17824:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788846128.844477:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788846128.844479:0:17824:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788846128.844481:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846128.844483:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.844484:0:17824:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788846128.844486:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788846128.844488:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.844490:0:17824:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788846128.844493:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788846128.844517:0:17824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788846128.844541:0:17824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788846128.844543:0:17824:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788846128.844546:0:17824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788846128.844641:0:17820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788846128.844669:0:17820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788846128.844682:0:17820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.844701:0:17820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42ca00/0x21b4d56138272b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272b76 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846128.844710:0:17820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e475188800 from 1 10000000:01000000:2.0:1788846128.844712:0:17820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788846128.844734:0:17820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.844742:0:17820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.844753:0:17820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846128.844767:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846128.844804:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.844826:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b58fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846128.844843:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702446464 00000100:00100000:2.0:1788846128.844850:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702446464 00000100:00100000:2.0:1788846128.844881:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788846128.844887:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+15:17820:x1875740702446464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846128.844898:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846128.844909:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272bf4 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.844930:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 16 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.844950:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 16 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.844972:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42da00, rc 0) 00000100:00100000:2.0:1788846128.845002:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:17820:x1875740702446464:12345-0@lo:101:mount.lustre.0 Request processed in 115us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846128.845008:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788846128.845046:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846128.845059:0:17820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.845066:0:17820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846128.845445:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702446208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846128.845829:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446592:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788846128.845870:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788846128.845949:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846128.845954:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788846128.845956:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846128.845969:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846128.846024:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d6a8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788846128.846163:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702446592 00000100:00100000:1.0:1788846128.846169:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702446592 00000100:00100000:1.0:1788846128.846229:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788846128.846237:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:17820:x1875740702446592:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788846128.846253:0:17083:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788846128.846281:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788846128.846285:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788846128.846380:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:17820:x1875740702446592:12345-0@lo:256:mount.lustre.0 Request processed in 144us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846128.846396:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788846128.846455:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446592:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788846128.847031:0:17820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788846128.847053:0:17820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.847063:0:17820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846128.847070:0:17820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e475188800 from 1 10000000:01000000:3.0:1788846128.847073:0:17820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788846128.847098:0:17820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.847106:0:17820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.847115:0:17820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846128.847130:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846128.847159:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846128.849597:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846128.849723:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702446720 00000100:00100000:2.0:1788846128.849732:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702446720 00000100:00100000:2.0:1788846128.849776:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788846128.849785:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:17820:x1875740702446720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846128.849799:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846128.849817:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272c02 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.849845:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272c02 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.849871:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c02 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.849880:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c000, rc 0) 00000100:00100000:2.0:1788846128.849931:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702446720:12345-0@lo:101:mount.lustre.0 Request processed in 147us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846128.849937:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788846128.850224:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846128.850247:0:17820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.850257:0:17820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846128.850461:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846128.850498:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846128.850558:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846128.850580:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788846128.850648:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702446848 00000100:00100000:2.0:1788846128.850653:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702446848 00000100:00100000:2.0:1788846128.850674:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788846128.850844:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702446848:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846128.850932:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702446848:12345-0@lo:501:mount.lustre.0 Request processed in 90us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846128.850986:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846128.851010:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446976:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846128.851043:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846128.851055:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.851195:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702446976 00000100:00100000:0.0:1788846128.851200:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702446976 00000100:00100000:2.0:1788846128.851345:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788846128.851433:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788846128.851440:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702446976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846128.851535:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702446976:12345-0@lo:503:mount.lustre.0 Request processed in 79us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.851552:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788846128.851613:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702446976:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788846128.851913:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846128.851987:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846128.852017:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846128.852294:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846128.852382:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702447104 00000100:00100000:1.0:1788846128.852387:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702447104 00000100:00100000:2.0:1788846128.852418:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788846128.852426:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702447104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846128.852512:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702447104:12345-0@lo:502:mount.lustre.0 Request processed in 87us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846128.852538:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788846128.852626:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846128.852817:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788846128.852843:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788846128.852858:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788846128.852870:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788846128.852881:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788846128.852894:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788846128.852916:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788846128.852927:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788846128.852939:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788846128.852949:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788846128.853114:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788846128.853144:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846128.853183:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846128.853257:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.853395:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702447232 00000100:00100000:0.0:1788846128.853400:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702447232 00000100:00100000:0.0:1788846128.853423:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788846128.853430:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702447232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846128.853512:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702447232:12345-0@lo:502:mount.lustre.0 Request processed in 82us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.853533:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788846128.853616:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846128.853651:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788846128.853658:0:17820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788846128.854199:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846128.854208:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846128.854210:0:17834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788846128.854216:0:17834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e475188800 00000020:00000080:3.0:1788846128.854219:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846128.854226:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846128.854228:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846128.854229:0:17834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788846128.854231:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846128.854234:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846128.854235:0:17834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788846128.854238:0:17834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e475188800 00000020:00000080:3.0:1788846128.854240:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846128.854310:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846128.854314:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846128.854316:0:17834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788846128.854318:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846128.854321:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846128.854322:0:17834:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788846128.854326:0:17834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e475188800 00000020:00000080:3.0:1788846128.854333:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846128.854351:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846128.854353:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846128.854355:0:17834:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788846128.854357:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846128.854359:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846128.854361:0:17834:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788846128.854364:0:17834:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e475188800 00000020:00000080:3.0:1788846128.854365:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788846128.854383:0:17834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846128.854386:0:17834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846128.854387:0:17834:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788846128.854389:0:17834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788846128.857950:0:17820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788846128.857997:0:17820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788846128.858017:0:17820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846128.858029:0:17820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846128.858082:0:17820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788846128.858085:0:17820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e475188800 10000000:01000000:0.0:1788846128.858088:0:17820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e475188800 10000000:01000000:0.0:1788846128.858092:0:17820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788846128.858097:0:17820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e475188800 from 1 10000000:01000000:0.0:1788846128.858099:0:17820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788846128.858133:0:17820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846128.858141:0:17820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846128.858152:0:17820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846128.858182:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788846128.858249:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.858288:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846128.860407:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702447360 00000100:00100000:2.0:1788846128.860417:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702447360 00000100:00100000:2.0:1788846128.860465:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788846128.860474:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17820:x1875740702447360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846128.860488:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846128.860504:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42de00/0x21b4d56138272c17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272c10 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.860548:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42de00/0x21b4d56138272c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272c10 expref: 18 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.860560:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42de00/0x21b4d56138272c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c10 expref: 18 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.860569:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42de00, rc 0) 00000100:00100000:2.0:1788846128.867150:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447360:12345-0@lo:101:mount.lustre.0 Request processed in 6670us (8894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846128.867161:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788846128.867342:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846128.867368:0:17820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846128.867382:0:17820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788846128.868600:0:17820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788846128.868850:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846128.869706:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788846128.869736:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788846128.869747:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788846128.869759:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788846128.869770:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788846128.869798:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788846128.869813:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788846128.869826:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788846128.869840:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788846128.869851:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788846128.869863:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788846128.869877:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788846128.869890:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788846128.869903:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788846128.869915:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788846128.869926:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788846128.869937:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788846128.870782:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788846128.870824:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788846128.870840:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788846128.870854:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788846128.879763:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788846128.879801:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788846128.879817:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788846128.879833:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788846128.879845:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788846128.879857:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788846128.879868:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788846128.879893:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788846128.879898:0:17820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788846128.880010:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846128.880085:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.880134:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846128.880361:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702447488 00000100:00100000:2.0:1788846128.880369:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702447488 00000100:00100000:2.0:1788846128.880417:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788846128.880427:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846128.880569:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447488:12345-0@lo:501:mount.lustre.0 Request processed in 143us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846128.880577:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788846128.880667:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846128.880697:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846128.880738:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.880766:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846128.880804:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702447616 00000100:00100000:2.0:1788846128.880808:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702447616 00000100:00100000:2.0:1788846128.880834:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788846128.880841:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846128.880921:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447616:12345-0@lo:503:mount.lustre.0 Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846128.880928:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788846128.881062:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788846128.881595:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788846128.881651:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846128.881688:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.881714:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702447744 00000100:00100000:0.0:1788846128.881718:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702447744 00000100:00100000:0.0:1788846128.881745:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788846128.881752:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846128.881832:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447744:12345-0@lo:502:mount.lustre.0 Request processed in 80us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.881839:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788846128.881871:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.881883:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846128.882226:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788846128.882252:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1788846128.882266:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1788846128.882365:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1788846128.882378:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1788846128.882390:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1788846128.882418:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1788846128.882433:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1788846128.882448:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1788846128.882460:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1788846128.882472:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1788846128.882484:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1788846128.882496:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1788846128.882509:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1788846128.883144:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1788846128.883167:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1788846128.883182:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1788846128.883194:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1788846128.883206:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1788846128.883220:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1788846128.883234:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1788846128.883246:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1788846128.884127:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1788846128.884165:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1788846128.884180:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1788846128.884202:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1788846128.884213:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1788846128.884224:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1788846128.884235:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1788846128.884246:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1788846128.884257:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1788846128.885108:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1788846128.885151:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1788846128.885167:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1788846128.885182:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1788846128.885194:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1788846128.885206:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1788846128.885217:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1788846128.885243:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1788846128.885255:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1788846128.885267:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1788846128.886157:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1788846128.886174:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1788846128.886188:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1788846128.886202:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1788846128.886216:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1788846128.886228:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1788846128.886242:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1788846128.887168:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846128.887249:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.887443:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702447872 00000100:00100000:0.0:1788846128.887450:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702447872 00000100:00100000:0.0:1788846128.887492:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788846128.887500:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846128.887683:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702447872:12345-0@lo:502:mount.lustre.0 Request processed in 182us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.887700:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788846128.887753:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.887776:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702447872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846128.890288:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1788846128.890348:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1788846128.890389:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702448000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846128.890458:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.890493:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702448000 00000100:00100000:0.0:1788846128.890499:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702448000 00000100:00100000:0.0:1788846128.890552:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788846128.890560:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702448000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846128.890648:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702448000:12345-0@lo:502:mount.lustre.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.890655:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788846128.890699:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.890716:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702448000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846128.890753:0:17820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788846128.890759:0:17820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788846128.893810:0:17841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788846128.893826:0:17841:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff90e474c799b8) 00000020:00000080:1.0:1788846128.893847:0:17841:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788846128.893922:0:17841:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e475188800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788846128.893926:0:17841:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e475188800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788846128.893928:0:17841:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e475188800 3 00010000:00080000:1.0:1788846128.893957:0:17841:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e47f495800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.120@tcp at head 00010000:00010000:1.0:1788846128.898894:0:17841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788846128.899716:0:17841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788846128.899761:0:17841:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788846128.899774:0:17841:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x21b4d56138272c25 00000100:00080000:1.0:1788846128.899785:0:17841:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788846128.899791:0:17841:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90e47f495800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846128.899826:0:17841:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344576300 x1875740702448128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846128.899863:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702448128:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788846128.899931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846128.901948:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702448128 00000100:00100000:1.0:1788846128.902339:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702448128 00000100:00100000:1.0:1788846128.902392:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846128.902400:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3639:x1875740702448128:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788846128.902427:0:17090:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1788846128.903132:0:17090:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x21b4d56138272c2c 00000004:00100000:1.0:1788846128.903151:0:17090:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788846128.903205:0:17090:0:(import.c:65:import_set_state_nolock()) ffff90e447150800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846128.903777:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1875740702448128:12345-0@lo:38:llog_process_th.0 Request processed in 1374us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846128.903786:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788846128.903833:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e344576300 x1875740702448128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846128.903843:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788846128.903851:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788846128.903858:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788846128.903862:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788846128.903865:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f495800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788846128.903870:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3639:1875740702448128:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788846128.904876:0:17841:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788846128.905554:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846128.905561:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846128.905563:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846128.905567:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788846128.908387:0:17841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1788846128.910422:0:17820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788846128.910614:0:17820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788846128.910635:0:17820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.910647:0:17820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441356a00/0x21b4d56138272c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c17 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788846128.910696:0:17820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788846128.910698:0:17820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788846128.910699:0:17820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846128.910701:0:17820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846128.910702:0:17820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846128.910704:0:17820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846128.910705:0:17820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846128.910707:0:17820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846128.910708:0:17820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788846128.910711:0:17820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788846128.910714:0:17820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788846128.910715:0:17820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788846128.910716:0:17820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846128.910718:0:17820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846128.910719:0:17820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846128.910726:0:17820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846128.910727:0:17820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846128.910728:0:17820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846128.910729:0:17820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788846128.910755:0:17820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788846128.910777:0:17820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702448256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788846128.911029:0:17820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.911126:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702448256 00000100:00100000:0.0:1788846128.911134:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702448256 00000100:00100000:1.0:1788846128.911144:0:17820:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.911182:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788846128.911191:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702448256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788846128.911215:0:17082:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788846128.911228:0:17082:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788846128.914705:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788846128.914920:0:17082:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788846128.914931:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788846128.915239:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17820:x1875740702448256:12345-0@lo:253:mount.lustre.0 Request processed in 4043us (4276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.915251:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 20000000:01000000:1.0:1788846128.915980:0:17104:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788846128.915988:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788846128.916008:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.916025:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272b30 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.916033:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.916039:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.916074:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.916090:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 17 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846128.916103:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344577b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702448384:0@lo:104: 00000100:00100000:1.0:1788846128.916145:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846128.916195:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272b30 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846128.916215:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272b30 expref: 17 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846128.916224:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702448512:0@lo:104: 00000100:00100000:1.0:1788846128.916246:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846128.916272:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788846128.916452:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702448384 00000100:00100000:3.0:1788846128.916460:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702448384 00000100:00100000:3.0:1788846128.916491:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702448512 00000100:00100000:3.0:1788846128.916495:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702448512 00000100:00100000:3.0:1788846128.916708:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846128.916720:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:17104:x1875740702448384:12345-0@lo:104: 00010000:00010000:3.0:1788846128.916741:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.916800:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846128.916808:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:17104:x1875740702448384:12345-0@lo:104: Request processed in 91us (662us total) trans 0 rc 0/0 00010000:00010000:2.0:1788846128.916809:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788846128.916818:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788846128.916819:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846128.916835:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846128.916842:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:17104:x1875740702448512:12345-0@lo:104: 00010000:00010000:3.0:1788846128.916850:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.916883:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846128.916888:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:17104:x1875740702448512:12345-0@lo:104: Request processed in 48us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846128.916894:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788846128.916908:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788846128.917076:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344577b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702448384:0@lo:104: 00000100:00100000:1.0:1788846128.917085:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702448512:0@lo:104: 00010000:00010000:1.0:1788846128.917109:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846128.917139:0:17820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:17820:1875740702448256:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788846128.917153:0:17820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788846128.917156:0:17820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788846128.917158:0:17820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788846128.917159:0:17820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788846128.917160:0:17820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788846128.917162:0:17820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788846128.917163:0:17820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788846128.917165:0:17820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788846128.917167:0:17820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788846128.917169:0:17820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788846128.917178:0:17820:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788846128.917268:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846128.917273:0:17077:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.917282:0:17077:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846128.917289:0:17077:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846128.917294:0:17077:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788846128.917336:0:17077:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.917342:0:17077:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846128.917364:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.917371:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42d800/0x21b4d56138272bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272bfb expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.917382:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846128.917383:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846128.917385:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846128.917403:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702448640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846128.917439:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788846128.917593:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846128.917600:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.917608:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357c00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846128.917611:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.917619:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846128.917626:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846128.917639:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788846128.917665:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.917672:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846128.917694:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.917702:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441357c00/0x21b4d56138272b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272b37 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846128.917703:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702448768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846128.917725:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846128.917727:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846128.917729:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846128.917736:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846128.917739:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846128.917745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.917797:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702448640 00000100:00100000:2.0:1788846128.917802:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702448640 00010000:00010000:2.0:1788846128.917847:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 18 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846128.917881:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702448768 00000100:00100000:3.0:1788846128.917914:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846128.917923:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:3643:x1875740702448640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846128.917934:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846128.917940:0:17075:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 18 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.917951:0:17075:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 18 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.917965:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42da00/0x21b4d56138272bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272bf4 expref: 18 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846128.917977:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846128.918015:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:3643:x1875740702448640:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846128.918023:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788846128.918578:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702448768 00010000:00010000:2.0:1788846128.918597:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272b30 expref: 17 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846128.918624:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846128.918632:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:3640:x1875740702448768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846128.918641:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846128.918646:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272b30 expref: 17 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918656:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272b30 expref: 17 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918668:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064c00/0x21b4d56138272b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272b30 expref: 17 pid: 17080 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918680:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918689:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788846128.918703:0:17073:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002940532s 00010000:00010000:2.0:1788846128.918708:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918726:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918734:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918740:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918747:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846128.918751:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918759:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918775:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.918786:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846128.918828:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:3640:x1875740702448768:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846128.918838:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846128.918879:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702448640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846128.918905:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702448768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846128.926741:0:17104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.926756:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846128.926775:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272c33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1788846128.938226:0:17820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788846128.938263:0:17847:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788846128.938268:0:17847:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788846128.942795:0:17848:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788846128.943427:0:17848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788846128.944195:0:17820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788846128.946601:0:17849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17849:1875740702448896:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788846128.946675:0:17849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.946831:0:17849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e44537e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788846128.946941:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702448896 00000100:00100000:3.0:1788846128.946950:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702448896 00000100:00100000:3.0:1788846128.946995:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846128.947004:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17849:x1875740702448896:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788846128.947089:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17849:x1875740702448896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846128.947096:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:3.0:1788846128.947368:0:17820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788846128.947405:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788846128.948492:0:17849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17849:1875740702448896:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788846128.948775:0:17849:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788846128.948894:0:17849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17849:1875740702449024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788846128.948952:0:17849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.949020:0:17849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e44537e480 going to sleep for 11 seconds 00000004:00000080:3.0:1788846128.949165:0:17820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788846128.949185:0:17820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788846128.949276:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846128.950398:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788846128.950940:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788846128.950970:0:17820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788846128.951067:0:17820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846128.952597:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788846128.952729:0:17848:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788846128.955668:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702449024 00000100:00100000:1.0:1788846128.955681:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702449024 00000100:00100000:1.0:1788846128.955740:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846128.955750:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17849:x1875740702449024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788846128.955932:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17849:x1875740702449024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 183us (6978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846128.955947:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00080000:10000000:3.0:1788846128.958394:0:17820:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:2.0:1788846128.961689:0:17849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17849:1875740702449024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788846128.961779:0:17849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17849:1875740702449152:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788846128.961840:0:17849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846128.961883:0:17849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e44537e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.962132:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702449152 00000100:00100000:0.0:1788846128.962140:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702449152 00000100:00100000:0.0:1788846128.962202:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788846128.962214:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17849:x1875740702449152:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788846128.962278:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17849:x1875740702449152:12345-0@lo:900:lod0001_rec0000.0 Request processed in 57us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.962286:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788846128.962375:0:17849:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e343a3a680 x1875740702449152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788846144 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846128.962390:0:17849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17849:1875740702449152:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788846128.962453:0:17849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17849:1875740702449280:0@lo:1000:lod0001_rec0000.0 00000001:00000004:3.0:1788846128.962482:0:17820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788846128.962489:0:17849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846128.962553:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702449280 00000100:00100000:2.0:1788846128.962555:0:17849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e44537e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788846128.962559:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702449280 00000100:00100000:0.0:1788846128.962606:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788846128.962625:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17849:x1875740702449280:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788846128.962683:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17849:x1875740702449280:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846128.962690:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846128.962811:0:17849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17849:1875740702449280:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788846128.962852:0:17849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788846128.970425:0:17820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788846128.970467:0:17820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb1f081c5f988 00100000:10000000:3.0:1788846128.970476:0:17820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788846128.970917:0:17820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788846128.970952:0:17820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788846128.970967:0:17820:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788846128.970983:0:17820:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788846128.972023:0:17820:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000040:00080000:2.0:1788846128.973449:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788846128.973545:0:17849:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788846128.973550:0:17849:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:3.0:1788846128.975419:0:17820:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788846129.273918:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:2.0:1788846129.850056:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846129.915308:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788846130.297728:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 10000000:01000000:0.0:1788846130.684277:0:17086:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846130.684294:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e475188800 from 8 10000000:01000000:0.0:1788846130.684299:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846130.684341:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846130.684354:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846130.684377:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846130.684403:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702449408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846130.684473:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846130.685214:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4517f99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846130.685297:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702449408 00000100:00100000:2.0:1788846130.685306:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702449408 00000100:00100000:2.0:1788846130.685360:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788846130.685370:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:17086:x1875740702449408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846130.685384:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846130.685400:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272c3a expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846130.685425:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272c3a expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846130.685435:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c3a expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846130.685444:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:2.0:1788846130.685800:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702449408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846130.685807:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788846130.694948:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702449408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846130.694981:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846130.694995:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846130.695406:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702449536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788846130.695485:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846130.695548:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341da3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846130.695618:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702449536 00000100:00100000:0.0:1788846130.695625:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702449536 00000100:00100000:0.0:1788846130.695677:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788846130.695687:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702449536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788846130.695707:0:17082:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788846130.695734:0:17082:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788846130.695738:0:17082:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788846130.695847:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702449536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846130.695855:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788846130.695957:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702449536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788846130.696009:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788846130.696018:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846130.696026:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846130.696047:0:17086:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788846130.696049:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e344550800 from 8 10000000:01000000:3.0:1788846130.696052:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788846130.696075:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846130.696082:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846130.696091:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846130.696236:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702449664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788846130.696275:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846130.696311:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d6a8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846130.696352:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702449664 00000100:00100000:0.0:1788846130.696357:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702449664 00000100:00100000:0.0:1788846130.696393:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788846130.696402:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702449664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846130.696412:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846130.696425:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272c48 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846130.696456:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272c48 expref: 18 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846130.696478:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c48 expref: 18 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846130.696487:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356600, rc 0) 00000100:00100000:0.0:1788846130.696552:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17086:x1875740702449664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846130.696558:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788846130.696595:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702449664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846130.696607:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846130.696616:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846130.696658:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702449792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788846130.696690:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846130.696711:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d6a8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788846130.696790:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702449792 00000100:00100000:1.0:1788846130.696795:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702449792 00000100:00100000:1.0:1788846130.696831:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788846130.696838:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17086:x1875740702449792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788846130.696849:0:17083:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788846130.696862:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788846130.696865:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788846130.696939:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17086:x1875740702449792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846130.696946:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788846130.697194:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702449792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788846130.697229:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788846130.697234:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846130.697242:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846130.877275:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846130.939631:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846131.323844:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:3.0:1788846131.899704:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846132.360824:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00010000:00010000:2.0:1788846132.928653:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846133.370816:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 0 seconds 00000001:02000400:3.0:1788846133.720489:0:18092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788846133.945733:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788846134.074740:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788846134.074746:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788846134.074764:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846134.074775:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90e451763800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846134.074807:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e343a3b800 x1875740702450048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846134.074825:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846134.074829:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846134.074832:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846134.074835:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846134.074857:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846134.074860:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846134.074863:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846134.074866:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846134.074895:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702450048:0@lo:38:kworker.0 00000100:00100000:1.0:1788846134.074898:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702450432:0@lo:400:kworker.0 00000100:00100000:3.0:1788846134.074983:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702449920:0@lo:400:kworker.0 00000100:00100000:2.0:1788846134.075083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846134.075161:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702450176:0@lo:400:kworker.0 00000100:00100000:2.0:1788846134.075187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846134.075856:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846134.075865:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702450304:0@lo:400:kworker.0 00000100:00100000:2.0:1788846134.075895:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846134.075933:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702450048 00000100:00100000:2.0:1788846134.075940:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702450048 00000100:00100000:2.0:1788846134.075968:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702450304 00000100:00100000:2.0:1788846134.075971:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702450304 00000100:00100000:2.0:1788846134.076007:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846134.076022:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3639:x1875740702450048:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788846134.076050:0:17094:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:2.0:1788846134.076091:0:17094:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138272c56 00000004:00100000:2.0:1788846134.076107:0:17094:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788846134.076112:0:17094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788846134.076200:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702450176 00000100:00100000:2.0:1788846134.076205:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702450176 00000100:00100000:2.0:1788846134.076235:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846134.076242:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702450176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846134.076306:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702450176:12345-0@lo:400:kworker.0 Request processed in 65us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846134.076313:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788846134.076335:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846134.076342:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702450304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846134.076372:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702450304:12345-0@lo:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846134.076378:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846134.076417:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702450304:0@lo:400:kworker.0 00010000:00080000:2.0:1788846134.076428:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e343a39c00 x1875740702450176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846134.076438:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702450176:0@lo:400:kworker.0 00000100:00100000:1.0:1788846134.077141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846134.077220:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702450432 00000100:00100000:2.0:1788846134.077227:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702450432 00000100:00100000:2.0:1788846134.077258:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788846134.077277:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702450432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846134.078286:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702450432:12345-0@lo:400:kworker.0 Request processed in 1006us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846134.078294:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788846134.078364:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e343a38380 x1875740702450432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846134.078379:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702450432:0@lo:400:kworker.0 00000100:00100000:1.0:1788846134.078397:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788846134.078406:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702450560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846134.078446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846134.078923:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846134.078985:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702449920 00000100:00100000:3.0:1788846134.078992:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702449920 00000100:00100000:3.0:1788846134.079029:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788846134.079037:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:3641:x1875740702449920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846134.079084:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:3641:x1875740702449920:12345-0@lo:400:kworker.0 Request processed in 47us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846134.079091:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788846134.079105:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702449920:0@lo:400:kworker.0 00000100:00100000:2.0:1788846134.079968:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702450560 00000100:00100000:2.0:1788846134.079975:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702450560 00000100:00100000:2.0:1788846134.080118:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846134.082679:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702450560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846134.082726:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788846134.082841:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702450560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2715us (4393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846134.082849:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788846134.083006:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702450560:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788846134.090346:0:17094:0:(import.c:65:import_set_state_nolock()) ffff90e3424f7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788846134.090570:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702450048:12345-0@lo:38:kworker.0 Request processed in 14545us (15485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846134.090581:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788846134.090656:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788846134.090666:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788846134.090672:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788846134.090675:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e451763800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788846134.090694:0:3639:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000043c214ba): req@ffff90e343a3aa00 x1875740702443136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846134.091866:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846134.091897:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187240 going to sleep for 11 seconds 00000100:00100000:1.0:1788846134.092050:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702443136 00000100:00100000:1.0:1788846134.092069:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702443136 00000100:00100000:1.0:1788846134.092114:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788846134.092581:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17130:x1875740702443136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788846134.092679:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17130:x1875740702443136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 557us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846134.092687:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846134.093644:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702450048:0@lo:38:kworker.0 00000100:00100000:1.0:1788846134.093700:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702450688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846134.093886:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3aa00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1875740702443136:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788846134.093923:0:17130:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788846134.093924:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846134.093959:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1875740702450816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846134.093999:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846134.094141:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d6a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846134.094142:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702450688 00000100:00100000:0.0:1788846134.094149:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702450688 00000100:00100000:2.0:1788846134.094195:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702450816 00000100:00100000:2.0:1788846134.094201:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702450816 00000100:00100000:1.0:1788846134.094224:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846134.094232:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846134.094242:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17130:x1875740702450816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788846134.094342:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875740702450688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846134.094368:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846134.094668:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:3642:x1875740702450688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 434us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846134.094676:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788846134.095027:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702450688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788846134.095373:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17130:x1875740702450816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 1132us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846134.095381:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788846134.096787:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1875740702450816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846134.096887:0:17130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1875740702450944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788846134.096934:0:17130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846134.096971:0:17130:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d6a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788846134.097046:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702450944 00000100:00100000:0.0:1788846134.097053:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702450944 00000100:00100000:0.0:1788846134.097150:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846134.097160:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17130:x1875740702450944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788846134.097242:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17130:x1875740702450944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 83us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846134.097249:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788846134.097314:0:17130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17130:1875740702450944:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788846134.097359:0:17130:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846134.100488:0:17130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788846134.100589:0:17130:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1788846134.100595:0:17130:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788846134.611439:0:18144:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788846134.616244:0:18144:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788846134.969820:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788846135.694033:0:18194:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788846135.694196:0:18194:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788846135.993770:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788846136.833912:0:18242:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc78e918f0 20000000:00000080:0.0:1788846136.833934:0:18242:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e4762d7400 uarg=0000000000000000 20000000:01000000:0.0:1788846136.833969:0:18242:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788846136.833976:0:18242:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788846136.833980:0:18242:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788846136.835800:0:18243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788846136.835943:0:18242:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788846136.847026:0:18242:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788846136.847055:0:18242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.847075:0:18242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272aff expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.847084:0:18242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c02 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.847092:0:18242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.847331:0:18242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272c02 expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.847413:0:18242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272c02 expref: 17 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846136.847428:0:18242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18242:1875740702451072:0@lo:104: 00000100:00100000:0.0:1788846136.847753:0:18242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788846136.847814:0:18242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272aff expref: 17 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.847824:0:18242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272aff expref: 17 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846136.847849:0:18242:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18242:1875740702451200:0@lo:104: 00000100:00100000:0.0:1788846136.847873:0:18242:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846136.847902:0:18242:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442d8f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788846136.847952:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702451072 00000100:00100000:1.0:1788846136.847959:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702451072 00000100:00100000:1.0:1788846136.847995:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702451200 00000100:00100000:1.0:1788846136.847998:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702451200 00000100:00100000:1.0:1788846136.848013:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846136.848021:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:18242:x1875740702451072:12345-0@lo:104: 00010000:00010000:1.0:1788846136.848035:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846136.848100:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788846136.848106:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:18242:x1875740702451072:12345-0@lo:104: Request processed in 87us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846136.848132:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788846136.848151:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788846136.848158:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788846136.848159:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:18242:x1875740702451200:12345-0@lo:104: 00010000:00010000:2.0:1788846136.848170:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846136.848171:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848192:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064e00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846136.848198:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848207:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846136.848215:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846136.848222:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788846136.848233:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788846136.848241:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:18242:x1875740702451200:12345-0@lo:104: Request processed in 83us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846136.848256:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788846136.848268:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846136.848272:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846136.848279:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846136.848279:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846136.848289:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846136.848293:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846136.848300:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848302:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846136.848315:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848318:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272c02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c09 expref: -99 pid: 17820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846136.848329:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788846136.848357:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846136.848359:0:17844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848361:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846136.848364:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846136.848370:0:17844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788846136.848386:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702451328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846136.848398:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846136.848406:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42c800/0x21b4d56138272aff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272b06 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846136.848423:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846136.848425:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846136.848429:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846136.848430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846136.848443:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702451456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846136.848469:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702451328 00000100:00100000:2.0:1788846136.848475:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702451328 00000100:00100000:1.0:1788846136.848495:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846136.848496:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c02 expref: 18 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846136.848559:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702451456 00000100:00100000:2.0:1788846136.848563:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702451456 00010000:00010000:2.0:1788846136.848576:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272aff expref: 19 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846136.848588:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788846136.848594:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:3643:x1875740702451328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846136.848604:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846136.848609:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c02 expref: 19 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848619:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272c02 expref: 19 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848632:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846136.848669:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:3643:x1875740702451328:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846136.848675:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788846136.848701:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846136.848704:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6db0807f-6150-4b75-b37b-0ed71f62ed94:3643:1875740702451328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846136.848712:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:3640:x1875740702451456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846136.848729:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846136.848734:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272aff expref: 18 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848753:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272aff expref: 18 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848765:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848773:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848786:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848793:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848800:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848807:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848814:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846136.848818:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848825:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848834:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.848850:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42c000/0x21b4d56138272c09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272c02 expref: 18 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846136.848853:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846136.848865:0:18242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18242:1875740702451072:0@lo:104: 00010000:00010000:0.0:1788846136.848879:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065600/0x21b4d56138272b06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272aff expref: 17 pid: 17080 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846136.848887:0:18242:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18242:1875740702451200:0@lo:104: 00000100:00100000:2.0:1788846136.848893:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:3640:x1875740702451456:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846136.848901:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788846136.848906:0:18242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.848916:0:18242:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.848922:0:18242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846136.848929:0:18242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441356000/0x21b4d56138272c5d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846136.848938:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702451456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846137.017723:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846137.402594:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788846138.042449:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846138.170599:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846128/real 1788846128] req@ffff90e343a3b480 x1875740702446336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846138.170628:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e343a3b480 x1875740702446336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846138.170639:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846128/real 1788846128] req@ffff90e343a39f80 x1875740702446080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846138.170651:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e343a39f80 x1875740702446080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788846138.170668:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846138.170686:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788846138.170690:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702446336:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788846138.170695:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846138.170700:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788846138.170703:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702446080:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788846138.170838:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846138.170842:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788846138.170845:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846138.170848:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788846138.170873:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846138.170876:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788846138.170879:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e44314c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846138.170883:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1788846138.170888:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788846138.170893:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90e44314c000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846138.170908:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b0a80 x1875740702452096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846138.170919:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846138.170921:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788846138.170923:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788846138.170925:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 512 00000100:00080000:0.0:1788846138.170928:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788846138.170930:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e446110000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846138.170937:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b3800 x1875740702452224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788846138.170965:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702451712:0@lo:400:kworker.0 00000100:00100000:0.0:1788846138.171018:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846138.171053:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846138.171057:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702451840:0@lo:400:kworker.0 00000100:00100000:0.0:1788846138.171077:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846138.171101:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702451840 00000100:00100000:0.0:1788846138.171107:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702451840 00000100:00100000:0.0:1788846138.171144:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788846138.171151:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702451840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846138.171210:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702451840:12345-0@lo:400:kworker.0 Request processed in 59us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846138.171217:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788846138.171351:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.171382:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846138.171398:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788846138.171402:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702451584:0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.171424:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846138.171442:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702452352:0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.171458:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846138.171478:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702451712 00000100:00100000:2.0:1788846138.171482:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702451712 00000100:00100000:2.0:1788846138.171503:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702451968 00000100:00100000:2.0:1788846138.171505:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702451968 00000100:00100000:2.0:1788846138.171518:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788846138.171549:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702451712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.171577:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702451712:12345-0@lo:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846138.171583:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788846138.171596:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788846138.171600:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702451968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.171623:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702451968:12345-0@lo:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846138.171628:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788846138.171641:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702452352 00000100:00100000:2.0:1788846138.171644:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702452352 00000100:00100000:2.0:1788846138.171656:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788846138.171661:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702452352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.171682:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702452352:12345-0@lo:400:kworker.0 Request processed in 22us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846138.171687:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788846138.171719:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e47d3b1500 x1875740702452352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846138.171731:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702452352:0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.171739:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702451968:0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.171756:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702452096:0@lo:8:kworker.0 00000400:00000100:2.0:1788846138.171775:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702452096 offset 0 length 520: 4 00000100:00100000:2.0:1788846138.171786:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702452224:0@lo:8:kworker.0 00000400:00000100:2.0:1788846138.171799:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702452224 offset 0 length 520: 4 00000100:00100000:0.0:1788846138.171930:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702451584 00000100:00100000:0.0:1788846138.171933:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702451584 00000100:00100000:0.0:1788846138.171964:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788846138.171970:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:3640:x1875740702451584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846138.172000:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:3640:x1875740702451584:12345-0@lo:400:kworker.0 Request processed in 30us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846138.172006:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788846138.172038:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e47d3b1180 x1875740702451840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846138.172048:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702451840:0@lo:400:kworker.0 00000100:00100000:0.0:1788846138.172056:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702451712:0@lo:400:kworker.0 00000100:00100000:2.0:1788846138.172171:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702451584:0@lo:400:kworker.0 10000000:01000000:2.0:1788846138.297653:0:17086:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788846138.297662:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e475188800 from 13 10000000:01000000:2.0:1788846138.297668:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846138.297720:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846138.297733:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846138.297745:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846138.297772:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846138.297855:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846138.297903:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d0ce480 going to sleep for 11 seconds 00000100:00100000:3.0:1788846138.300405:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702452480 00000100:00100000:3.0:1788846138.300420:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702452480 00000100:00100000:3.0:1788846138.300487:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788846138.300498:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+16:17086:x1875740702452480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846138.300513:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846138.300567:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272c64 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846138.300595:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272c64 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846138.300606:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c64 expref: 17 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846138.300616:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064400, rc 0) 00000100:00100000:3.0:1788846138.300692:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702452480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846138.300699:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788846138.300843:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846138.300860:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846138.300884:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846138.300958:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846138.300993:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846138.301030:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d0ce480 going to sleep for 11 seconds 00000100:00100000:0.0:1788846138.301265:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702452608 00000100:00100000:0.0:1788846138.301270:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702452608 00000100:00100000:0.0:1788846138.301306:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788846138.301314:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702452608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846138.301432:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702452608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846138.301439:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788846138.301624:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846138.301655:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846138.301695:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846138.301716:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d0ce480 going to sleep for 11 seconds 00000100:00100000:3.0:1788846138.301769:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702452736 00000100:00100000:3.0:1788846138.301773:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702452736 00000100:00100000:3.0:1788846138.301804:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788846138.301810:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702452736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846138.301904:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702452736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846138.301911:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788846138.301989:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788846138.303097:0:18305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788846138.303342:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788846138.303364:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788846138.303373:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846138.303392:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846138.303402:0:17086:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788846138.303406:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e344550800 from 13 10000000:01000000:3.0:1788846138.303408:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788846138.303439:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846138.303446:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846138.303455:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846138.303475:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788846138.303565:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846138.303597:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450b71c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846138.303876:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702452864 00000100:00100000:2.0:1788846138.303883:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702452864 00000100:00100000:2.0:1788846138.303925:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788846138.303933:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+17:17086:x1875740702452864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846138.303945:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846138.303959:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272c72 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846138.303981:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272c72 expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846138.303991:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c72 expref: 18 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846138.304012:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d800, rc 0) 00000100:00100000:2.0:1788846138.304064:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17086:x1875740702452864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846138.304070:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788846138.304252:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846138.304266:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846138.304285:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846138.304345:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846138.304373:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846138.304400:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846138.304547:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702452992 00000100:00100000:1.0:1788846138.304552:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702452992 00000100:00100000:1.0:1788846138.304580:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788846138.304588:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17086:x1875740702452992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846138.304701:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17086:x1875740702452992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846138.304708:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788846138.304826:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702452992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788846138.304866:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702453120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788846138.304902:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846138.305081:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846138.306943:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702453120 00000100:00100000:1.0:1788846138.306955:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702453120 00000100:00100000:1.0:1788846138.307020:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788846138.307029:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17086:x1875740702453120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788846138.307188:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:17086:x1875740702453120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846138.307196:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788846138.307422:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702453120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788846138.308287:0:18306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788846138.308551:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788846138.308572:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788846138.308583:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846138.308593:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846139.071609:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846139.194092:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702453248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846139.194161:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846139.199210:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846139.199241:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702453376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846139.199298:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846139.200850:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702453248 00000100:00100000:3.0:1788846139.200865:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702453248 00000100:00100000:3.0:1788846139.201068:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702453376 00000100:00100000:3.0:1788846139.201073:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702453376 00000100:00100000:3.0:1788846139.201094:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846139.201103:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702453248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788846139.201137:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788846139.201222:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702453248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (7060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846139.201242:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846139.201264:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788846139.201271:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702453376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788846139.201287:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788846139.201331:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702453376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846139.201338:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788846139.201385:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702453376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846139.201402:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702453248:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788846139.710716:0:17821:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788846140.090786:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846140.155131:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846140.222809:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846125/real 1788846125] req@ffff90e47d3b3b80 x1875740702444160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846140 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846140.222846:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e47d3b3b80 x1875740702444160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846140 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846140.222858:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846125/real 1788846125] req@ffff90e47d3b1880 x1875740702444288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846140 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846140.222873:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e47d3b1880 x1875740702444288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846140 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788846140.222895:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846140.222912:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788846140.222918:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702444160:0@lo:8:kworker.0 00000100:00080000:0.0:1788846140.222926:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788846140.222935:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788846140.222940:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702444288:0@lo:8:kworker.0 00000100:00080000:3.0:1788846140.229411:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846140.229421:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788846140.229426:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846140.229433:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:3.0:1788846140.229439:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788846140.229446:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e44314f800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846140.229483:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ec000 x1875740702453760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788846140.229511:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846140.229515:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788846140.229517:0:38:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846140.229533:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:3.0:1788846140.229536:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788846140.229555:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e47f491000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846140.229569:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ec380 x1875740702453888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788846140.229605:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846140.229608:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846140.229612:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846140.229615:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788846140.230489:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702453504:0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.230578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846140.230620:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702454272:0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.231327:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846140.231466:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788846140.231476:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702453632:0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.231510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846140.231601:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702454016:0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.231624:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846140.234922:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846140.234940:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702454144:0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.234998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846140.235041:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702453504 00000100:00100000:3.0:1788846140.235049:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702453504 00000100:00100000:3.0:1788846140.235098:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788846140.235106:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:3640:x1875740702453504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.235156:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:3640:x1875740702453504:12345-0@lo:400:kworker.0 Request processed in 51us (4578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846140.235177:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788846140.235428:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702453632 00000100:00100000:3.0:1788846140.235433:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702453632 00000100:00100000:3.0:1788846140.235457:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702454144 00000100:00100000:3.0:1788846140.235460:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702454144 00000100:00100000:3.0:1788846140.235475:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788846140.235481:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702453632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.235548:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702453632:12345-0@lo:400:kworker.0 Request processed in 66us (4037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846140.235555:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788846140.235568:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788846140.235575:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702454144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.235612:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702454144:12345-0@lo:400:kworker.0 Request processed in 37us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846140.235618:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788846140.235737:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702453632:0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.235751:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702453504:0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.235787:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702454144:0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.235803:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702453760:0@lo:8:kworker.0 00000400:00000100:3.0:1788846140.235823:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702453760 offset 0 length 520: 4 00000100:00100000:3.0:1788846140.235907:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702453888:0@lo:8:kworker.0 00000400:00000100:3.0:1788846140.235931:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875740702453888 offset 0 length 520: 4 00000100:00100000:1.0:1788846140.237866:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702454272 00000100:00100000:1.0:1788846140.237887:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702454272 00000100:00100000:1.0:1788846140.237996:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702454016 00000100:00100000:1.0:1788846140.238000:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702454016 00000100:00100000:3.0:1788846140.240773:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846140.240793:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702454272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.240897:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702454272:12345-0@lo:400:kworker.0 Request processed in 112us (9572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846140.240904:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846140.240927:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788846140.240935:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702454016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846140.240970:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702454016:12345-0@lo:400:kworker.0 Request processed in 36us (9345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846140.240976:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788846140.241022:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e47f4ef800 x1875740702454272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846140.241037:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702454272:0@lo:400:kworker.0 00010000:00080000:3.0:1788846140.241075:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e47f4eca80 x1875740702454016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846140.241085:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702454016:0@lo:400:kworker.0 00010000:00010000:1.0:1788846141.116651:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846142.137821:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846143.173327:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846144.185931:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788846144.257808:0:18591:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788846144.257813:0:18591:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788846144.257814:0:18591:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788846144.257925:0:18591:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e47f491800 00000020:01000004:3.0:1788846144.257941:0:18591:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788846144.257956:0:18591:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788846144.257969:0:18591:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90e341e54d28) 00000020:00000080:3.0:1788846144.257986:0:18591:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000100:00100000:0.0:1788846144.315815:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702454528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846144.316008:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702454400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846144.316189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.316357:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702454400 00000100:00100000:2.0:1788846144.316365:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702454400 00000100:00100000:2.0:1788846144.316419:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788846144.316428:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702454400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846144.316463:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788846144.316652:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702454400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.316660:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788846144.316754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702454400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846144.316995:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.317084:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702454528 00000100:00100000:2.0:1788846144.317088:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702454528 00000100:00100000:2.0:1788846144.317152:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846144.317160:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702454528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788846144.317181:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788846144.317238:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702454528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.317246:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788846144.317299:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702454528:0@lo:41:osp-pre-1-0.0 00100000:10000000:3.0:1788846144.334356:0:18591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788846144.339097:0:18591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788846144.339508:0:18591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788846144.340324:0:18591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788846144.340893:0:18591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788846144.341102:0:18591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788846144.341875:0:18591:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788846144.348045:0:18591:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788846144.348302:0:18591:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788846144.348315:0:18591:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788846144.348326:0:18591:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21b4d56138272c87 00000020:01000004:2.0:1788846144.348333:0:18591:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788846144.348355:0:18591:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788846144.348358:0:18591:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788846144.348363:0:18591:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788846144.348368:0:18591:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788846144.348380:0:18591:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90e47b68cd28) 00000020:00000080:2.0:1788846144.348390:0:18591:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788846144.350834:0:18591:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788846144.351028:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788846144.351033:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788846144.355284:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788846144.355297:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788846144.355738:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788846144.355746:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788846144.357139:0:18591:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846144.358034:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788846144.358042:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788846144.358861:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788846144.358871:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788846144.377352:0:18591:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788846144.377740:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788846144.377754:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788846144.380962:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788846144.380976:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788846144.382805:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788846144.382817:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788846144.388974:0:18591:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788846144.389408:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788846144.389416:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788846144.391003:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788846144.391013:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788846144.435717:0:18591:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788846144.435936:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788846144.435942:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788846144.437087:0:18591:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788846144.437097:0:18591:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788846144.437473:0:18591:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788846144.437502:0:18591:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788846144.437507:0:18591:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788846144.453840:0:18591:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788846144.453893:0:18591:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.120@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788846144.453898:0:18591:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788846144.453900:0:18591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846144.453901:0:18591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846144.453902:0:18591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846144.453904:0:18591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846144.453905:0:18591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846144.453907:0:18591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846144.453909:0:18591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846144.453910:0:18591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846144.453913:0:18591:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788846144.453915:0:18591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788846144.453916:0:18591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846144.453922:0:18591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846144.453923:0:18591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846144.453924:0:18591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846144.453925:0:18591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846144.453926:0:18591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846144.453927:0:18591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846144.453928:0:18591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846144.453968:0:18591:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788846144.453988:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702454656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788846144.454057:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.454109:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4517f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788846144.454168:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702454656 00000100:00100000:3.0:1788846144.454175:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702454656 00000100:00100000:3.0:1788846144.454239:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788846144.454248:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:18591:x1875740702454656:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788846144.454274:0:17082:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788846144.454277:0:17082:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788846144.454281:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788846144.454954:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:18591:x1875740702454656:12345-0@lo:253:mount.lustre.0 Request processed in 704us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846144.454963:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788846144.455136:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702454656:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788846144.455148:0:18591:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788846144.455801:0:18591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788846144.455803:0:18591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788846144.455804:0:18591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846144.455805:0:18591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846144.455807:0:18591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846144.455808:0:18591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846144.455810:0:18591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846144.455811:0:18591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846144.455812:0:18591:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788846144.455835:0:18591:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e47f491800 from lustre-OST0000 10000000:01000000:2.0:1788846144.455877:0:18591:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788846144.455880:0:18591:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788846144.455888:0:18591:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e34265b370 local copy 00010000:00010000:2.0:1788846144.455897:0:18591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846144.455987:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702454784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846144.456030:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.456068:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4517f99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846144.456146:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702454784 00000100:00100000:3.0:1788846144.456152:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702454784 00000100:00100000:3.0:1788846144.456208:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788846144.456217:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:18591:x1875740702454784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846144.456287:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:18591:x1875740702454784:12345-0@lo:501:mount.lustre.0 Request processed in 72us (256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788846144.456293:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788846144.456342:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702454784:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788846144.456363:0:18591:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788846144.456380:0:18591:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788846144.456386:0:18591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.456394:0:18591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846144.456415:0:18591:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e47f491800 10000000:01000000:2.0:1788846144.456420:0:18591:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788846144.456425:0:18591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788846144.456428:0:18591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788846144.456432:0:18591:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788846144.456435:0:18591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788846144.456455:0:18591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.456462:0:18591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.456470:0:18591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846144.456482:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702454912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846144.456508:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846144.456556:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702454912 00000100:00100000:2.0:1788846144.456558:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4517f99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846144.456562:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702454912 00000100:00100000:3.0:1788846144.456598:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788846144.456605:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+18:18591:x1875740702454912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846144.456615:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846144.456628:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475065c00/0x21b4d56138272c9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272c95 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.456659:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065c00/0x21b4d56138272c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272c95 expref: 19 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.456670:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475065c00/0x21b4d56138272c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c95 expref: 19 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.456679:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065c00, rc 0) 00000100:00100000:3.0:1788846144.456718:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702454912:12345-0@lo:101:mount.lustre.0 Request processed in 114us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846144.456725:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788846144.456844:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702454912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846144.456856:0:18591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.456871:0:18591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846144.458573:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788846144.459374:0:18591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846144.463093:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788846144.463169:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788846144.463188:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788846144.463215:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788846144.463229:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788846144.463242:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788846144.463267:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788846144.463273:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788846144.463376:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846144.463441:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846144.463485:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846144.463772:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702455040 00000100:00100000:2.0:1788846144.463781:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702455040 00000100:00100000:2.0:1788846144.463831:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788846144.463841:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846144.463981:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455040:12345-0@lo:501:mount.lustre.0 Request processed in 141us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.463988:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788846144.464220:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846144.464281:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455168:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846144.464326:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846144.464359:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541180 going to sleep for 11 seconds 00000100:00100000:2.0:1788846144.464857:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702455168 00000100:00100000:2.0:1788846144.464863:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702455168 00000100:00100000:2.0:1788846144.464893:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788846144.464901:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846144.465965:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455168:12345-0@lo:503:mount.lustre.0 Request processed in 1060us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846144.465977:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788846144.466059:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455168:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788846144.466760:0:18591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788846144.466855:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846144.466906:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846144.466984:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449541180 going to sleep for 11 seconds 00000100:00100000:2.0:1788846144.467022:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702455296 00000100:00100000:2.0:1788846144.467029:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702455296 00000100:00100000:2.0:1788846144.470742:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788846144.470767:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846144.471406:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455296:12345-0@lo:502:mount.lustre.0 Request processed in 648us (4497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.471415:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788846144.471559:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846144.471805:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788846144.471834:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788846144.471857:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788846144.471869:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788846144.471897:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788846144.471911:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788846144.471924:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788846144.471935:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788846144.471946:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788846144.471959:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788846144.471972:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788846144.471985:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788846144.472019:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846144.472062:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846144.472094:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846144.472189:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702455424 00000100:00100000:1.0:1788846144.472204:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702455424 00000100:00100000:1.0:1788846144.472249:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788846144.472257:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846144.472348:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455424:12345-0@lo:502:mount.lustre.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846144.472356:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788846144.472569:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846144.472612:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788846144.472620:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788846144.474047:0:18608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788846144.474058:0:18608:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788846144.474064:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.474067:0:18608:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788846144.474073:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788846144.474086:0:18608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90e46d51b370) 00000020:00000080:0.0:1788846144.474111:0:18608:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788846144.474117:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788846144.474321:0:18608:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e47f491800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788846144.474330:0:18608:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788846144.474338:0:18608:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x21b4d56138272caa 00010000:00010000:0.0:1788846144.478927:0:18608:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788846144.479474:0:18608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1788846144.480960:0:18608:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788846144.482047:0:18608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788846144.482057:0:18608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846144.482064:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.482066:0:18608:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788846144.482070:0:18608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788846144.482073:0:18608:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788846144.482074:0:18608:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846144.482076:0:18608:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788846144.482077:0:18608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788846144.482086:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.482087:0:18608:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788846144.482090:0:18608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846144.482094:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.482095:0:18608:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788846144.482098:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788846144.482099:0:18608:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788846144.482101:0:18608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846144.482103:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.482104:0:18608:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788846144.482106:0:18608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846144.482108:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.482109:0:18608:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788846144.482113:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788846144.482134:0:18608:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846144.482137:0:18608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.482138:0:18608:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788846144.482140:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788846144.482341:0:18591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788846144.482371:0:18591:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788846144.482392:0:18591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.482404:0:18591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42c600/0x21b4d56138272c95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272c9c expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846144.482412:0:18591:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47f491800 from 1 10000000:01000000:3.0:1788846144.482415:0:18591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788846144.482452:0:18591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.482459:0:18591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.482477:0:18591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846144.482498:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846144.482582:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846144.482624:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846144.486344:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702455552 00000100:00100000:2.0:1788846144.486357:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702455552 00000100:00100000:2.0:1788846144.486415:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788846144.486434:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:18591:x1875740702455552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846144.486454:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846144.486470:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272cb1 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.486497:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 20 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.486509:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 20 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.486517:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d600, rc 0) 00000100:00100000:2.0:1788846144.487395:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702455552:12345-0@lo:101:mount.lustre.0 Request processed in 961us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.487402:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788846144.490252:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846144.490280:0:18591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846144.490293:0:18591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788846144.491568:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788846144.491820:0:18591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846144.491987:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788846144.492008:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788846144.492022:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788846144.492026:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788846144.492086:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846144.492415:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846144.492454:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b6856c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846144.493375:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702455680 00000100:00100000:3.0:1788846144.493386:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702455680 00000100:00100000:3.0:1788846144.493461:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788846144.493472:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702455680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846144.493631:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702455680:12345-0@lo:501:mount.lustre.0 Request processed in 161us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846144.493639:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788846144.494430:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846144.494480:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846144.494890:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846144.494961:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4517f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846144.494996:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702455808 00000100:00100000:2.0:1788846144.495002:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702455808 00000100:00100000:2.0:1788846144.495071:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788846144.495080:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702455808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846144.495227:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702455808:12345-0@lo:503:mount.lustre.0 Request processed in 148us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.495235:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788846144.495305:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788846144.495762:0:18591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788846144.495829:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846144.495870:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846144.496376:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788846144.496421:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702455936 00000100:00100000:3.0:1788846144.496427:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702455936 00000100:00100000:1.0:1788846144.496470:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788846144.496486:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702455936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846144.496597:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702455936:12345-0@lo:502:mount.lustre.0 Request processed in 112us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846144.496604:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788846144.496804:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702455936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846144.496968:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788846144.496992:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788846144.497004:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788846144.497016:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788846144.497029:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788846144.497040:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788846144.497051:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788846144.497061:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788846144.497084:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788846144.497097:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788846144.497109:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788846144.497132:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846144.497294:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846144.497319:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47b685f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846144.497373:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702456064 00000100:00100000:2.0:1788846144.497378:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702456064 00000100:00100000:2.0:1788846144.497418:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788846144.497431:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702456064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846144.497508:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702456064:12345-0@lo:502:mount.lustre.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.497514:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788846144.497578:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846144.497618:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788846144.497625:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788846144.499081:0:18612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846144.499092:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.499094:0:18612:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788846144.499100:0:18612:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e47f491800 00000020:00000080:0.0:1788846144.499103:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846144.499110:0:18612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846144.499120:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.499122:0:18612:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788846144.499125:0:18612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846144.499128:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.499129:0:18612:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788846144.499132:0:18612:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e47f491800 00000020:00000080:0.0:1788846144.499134:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846144.499335:0:18612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846144.499339:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.499341:0:18612:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788846144.499343:0:18612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846144.499346:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.499348:0:18612:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846144.499351:0:18612:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e47f491800 00000020:00000080:0.0:1788846144.499353:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846144.499371:0:18612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846144.499374:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.499376:0:18612:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846144.499378:0:18612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846144.499380:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.499382:0:18612:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788846144.499385:0:18612:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e47f491800 00000020:00000080:0.0:1788846144.499387:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846144.499407:0:18612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846144.499410:0:18612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846144.499412:0:18612:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788846144.499415:0:18612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788846144.505329:0:18591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788846144.505379:0:18591:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846144.505409:0:18591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.505422:0:18591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846144.505488:0:18591:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788846144.505491:0:18591:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e47f491800 10000000:01000000:2.0:1788846144.505495:0:18591:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e47f491800 10000000:01000000:2.0:1788846144.505499:0:18591:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788846144.505505:0:18591:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e47f491800 from 1 10000000:01000000:2.0:1788846144.505508:0:18591:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788846144.505556:0:18591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.505565:0:18591:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.505575:0:18591:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846144.505605:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846144.505680:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.505716:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cf240 going to sleep for 11 seconds 00000100:00100000:0.0:1788846144.505839:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702456192 00000100:00100000:0.0:1788846144.505847:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702456192 00000100:00100000:0.0:1788846144.505892:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788846144.505901:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:18591:x1875740702456192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846144.505914:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846144.505933:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441356c00/0x21b4d56138272cc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272cbf expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846144.505956:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441356c00/0x21b4d56138272cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272cbf expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846144.505966:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441356c00/0x21b4d56138272cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272cbf expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846144.505974:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356c00, rc 0) 00000100:00100000:0.0:1788846144.506013:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456192:12345-0@lo:101:mount.lustre.0 Request processed in 114us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846144.506020:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788846144.506506:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846144.506541:0:18591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.506551:0:18591:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846144.507937:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788846144.508801:0:18591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846144.508981:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788846144.509007:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788846144.509022:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788846144.509034:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788846144.509045:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788846144.509056:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788846144.509068:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788846144.509081:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788846144.509093:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788846144.509105:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788846144.509117:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788846144.509129:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788846144.509141:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788846144.509845:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788846144.509871:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788846144.509885:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788846144.509898:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788846144.509922:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788846144.509936:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788846144.509949:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788846144.509962:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788846144.509986:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788846144.510000:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788846144.510014:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788846144.510027:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788846144.510041:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788846144.510054:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788846144.510068:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788846144.510082:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788846144.510095:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788846144.510108:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788846144.510121:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788846144.510135:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788846144.510148:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788846144.510242:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788846144.510261:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788846144.510275:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788846144.510308:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788846144.510315:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788846144.510420:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846144.510489:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.510563:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846144.510774:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702456320 00000100:00100000:0.0:1788846144.510782:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702456320 00000100:00100000:0.0:1788846144.510830:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788846144.510840:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846144.510961:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456320:12345-0@lo:501:mount.lustre.0 Request processed in 122us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846144.510969:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788846144.511050:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846144.511083:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846144.511118:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846144.511289:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702456448 00000100:00100000:0.0:1788846144.511294:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702456448 00000100:00100000:0.0:1788846144.511317:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788846144.511323:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846144.511399:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456448:12345-0@lo:503:mount.lustre.0 Request processed in 75us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846144.511406:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788846144.511453:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846144.511466:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456448:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788846144.512603:0:18591:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788846144.512815:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846144.512871:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.512946:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442b919c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846144.516293:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702456576 00000100:00100000:1.0:1788846144.516307:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702456576 00000100:00100000:1.0:1788846144.516398:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788846144.516409:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846144.516590:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456576:12345-0@lo:502:mount.lustre.0 Request processed in 182us (3717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846144.516598:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788846144.516708:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846144.516918:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788846144.516948:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788846144.516962:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788846144.516975:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788846144.516987:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788846144.517000:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788846144.517013:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788846144.517026:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788846144.517039:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788846144.517053:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788846144.517066:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788846144.517078:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788846144.517091:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788846144.517118:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788846144.517133:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788846144.517146:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788846144.517179:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788846144.517203:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788846144.517218:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788846144.517231:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788846144.517242:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788846144.517253:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788846144.517265:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788846144.517278:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788846144.517291:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788846144.517313:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788846144.517326:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788846144.517338:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788846144.517351:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788846144.517376:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788846144.517391:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788846144.517405:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788846144.517418:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788846144.517429:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788846144.517442:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788846144.517453:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788846144.517465:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788846144.517475:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788846144.517485:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788846144.517497:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788846144.517510:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788846144.517545:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788846144.517561:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788846144.517574:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788846144.517587:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788846144.517612:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788846144.517627:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788846144.517640:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788846144.517685:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846144.517742:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.518101:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442b919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846144.518145:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702456704 00000100:00100000:0.0:1788846144.518263:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702456704 00000100:00100000:0.0:1788846144.518296:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788846144.518303:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846144.518405:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456704:12345-0@lo:502:mount.lustre.0 Request processed in 102us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846144.518412:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788846144.518787:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846144.518938:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788846144.518960:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788846144.518984:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846144.519023:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.519086:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442b919c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846144.519184:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702456832 00000100:00100000:0.0:1788846144.519201:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702456832 00000100:00100000:0.0:1788846144.519230:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788846144.519237:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846144.519318:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702456832:12345-0@lo:502:mount.lustre.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846144.519324:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788846144.519400:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702456832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846144.519438:0:18591:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788846144.519445:0:18591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788846144.520338:0:18617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788846144.520352:0:18617:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90e46d51cd28) 00000020:00000080:0.0:1788846144.520374:0:18617:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788846144.520458:0:18617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e47f491800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788846144.520462:0:18617:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e47f491800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788846144.520464:0:18617:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e47f491800 3 00010000:00080000:0.0:1788846144.520954:0:18617:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e34363a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846144.523096:0:18617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788846144.523605:0:18617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788846144.524632:0:18617:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788846144.524647:0:18617:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x21b4d56138272cd4 00000100:00080000:2.0:1788846144.524669:0:18617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788846144.524675:0:18617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90e34363a000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846144.524711:0:18617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e3445d6d80 x1875740702456960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846144.524752:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702456960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846144.524819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788846144.524874:0:18617:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788846144.524893:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846144.524898:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846144.524901:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846144.524904:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846144.524927:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846144.524930:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788846144.524932:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702456960 00000100:00080000:2.0:1788846144.524933:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846144.524936:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788846144.524939:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702456960 00000100:00100000:2.0:1788846144.524964:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702457088:0@lo:400:kworker.0 00000100:00100000:0.0:1788846144.524965:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846144.524974:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702456960:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846144.524988:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788846144.524997:0:17089:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000100:00100000:2.0:1788846144.525022:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702457216:0@lo:400:kworker.0 00000020:00000080:0.0:1788846144.525032:0:17089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x21b4d56138272cdb 00000100:00100000:2.0:1788846144.525044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1788846144.525048:0:17089:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788846144.525076:0:17088:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00080000:0.0:1788846144.525078:0:17089:0:(import.c:65:import_set_state_nolock()) ffff90e343639800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846144.525083:0:17088:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788846144.525124:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1875740702456960:12345-0@lo:38:llog_process_th.0 Request processed in 150us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846144.525131:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846144.525144:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702457088 00000100:00100000:0.0:1788846144.525147:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702457088 00000100:00100000:0.0:1788846144.525164:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702457216 00000100:00100000:0.0:1788846144.525166:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702457216 00000100:00100000:0.0:1788846144.525178:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788846144.525184:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702457088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846144.525227:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702457088:12345-0@lo:400:kworker.0 Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846144.525232:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788846144.525243:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788846144.525248:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702457216:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788846144.525261:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e3445d6680 x1875740702457088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846144.525275:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702457088:0@lo:400:kworker.0 00000100:00100000:0.0:1788846144.525276:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702457216:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846144.525281:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788846144.525300:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e3445d6d80 x1875740702456960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788846144.525307:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e3445d7800 x1875740702457216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846144.525309:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846144.525315:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00100000:0.0:1788846144.525315:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702457216:0@lo:400:kworker.0 00000100:00080000:2.0:1788846144.525322:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788846144.525326:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788846144.525328:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e34363a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788846144.525333:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3639:1875740702456960:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788846144.525927:0:18617:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788846144.525940:0:18617:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90e449bdcd28) 00000020:00000080:0.0:1788846144.525957:0:18617:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788846144.526044:0:18617:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e47f491800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788846144.526048:0:18617:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e47f491800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788846144.526051:0:18617:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e47f491800 3 00010000:00080000:0.0:1788846144.526076:0:18617:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e44716a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846144.528093:0:18617:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788846144.528276:0:18617:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788846144.528317:0:18617:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788846144.528328:0:18617:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x21b4d56138272ce9 00000100:00080000:0.0:1788846144.528338:0:18617:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846144.528344:0:18617:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90e44716a800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846144.528376:0:18617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b3b80 x1875740702457344/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846144.528403:0:18617:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788846144.528444:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702457344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846144.528510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788846144.528593:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846144.528598:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846144.528601:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846144.528604:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846144.528607:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846144.528611:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846144.528613:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846144.528616:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846144.528642:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702457344 00000100:00100000:2.0:1788846144.528649:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702457344 00000040:00080000:0.0:1788846144.528675:0:18617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1788846144.529363:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788846144.529371:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702457344:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788846144.529395:0:17089:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1788846144.529425:0:17089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x21b4d56138272cf0 00000004:00100000:2.0:1788846144.529438:0:17089:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788846144.529480:0:17089:0:(import.c:65:import_set_state_nolock()) ffff90e344566000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846144.529556:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1875740702457344:12345-0@lo:38:llog_process_th.0 Request processed in 184us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.529563:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788846144.529601:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90e47d3b3b80 x1875740702457344/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846144.529611:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846144.529619:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788846144.529626:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788846144.529629:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788846144.529632:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44716a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788846144.529637:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3639:1875740702457344:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1788846144.529775:0:18591:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788846144.529810:0:18591:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788846144.529824:0:18591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.529834:0:18591:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42d000/0x21b4d56138272cbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272cc6 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788846144.529884:0:18591:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788846144.529886:0:18591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788846144.529888:0:18591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846144.529889:0:18591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846144.529890:0:18591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846144.529891:0:18591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846144.529892:0:18591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846144.529895:0:18591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846144.529896:0:18591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788846144.529899:0:18591:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788846144.529902:0:18591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788846144.529903:0:18591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788846144.529904:0:18591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846144.529905:0:18591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846144.529907:0:18591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846144.529908:0:18591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846144.529909:0:18591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846144.529910:0:18591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846144.529911:0:18591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788846144.529929:0:18591:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788846144.529944:0:18591:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702457472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788846144.529980:0:18591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846144.530006:0:18591:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846144.530424:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702457472 00000100:00100000:2.0:1788846144.530431:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702457472 00000100:00100000:2.0:1788846144.530473:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788846144.530480:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702457472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788846144.530501:0:17080:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788846144.530514:0:17080:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788846144.538667:0:17080:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788846144.538691:0:17080:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788846144.538878:0:17104:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788846144.538884:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788846144.538905:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.538925:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c3a expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.538933:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c48 expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.538941:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.538976:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272c48 expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.538990:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272c48 expref: 21 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846144.539010:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702457600:0@lo:104: 00000100:00100000:1.0:1788846144.539070:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846144.539124:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272c3a expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.539133:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272c3a expref: 21 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846144.539141:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702457728:0@lo:104: 00000100:00100000:1.0:1788846144.539182:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846144.539210:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788846144.539237:0:17072:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788846144.539255:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702457600 00000100:00100000:3.0:1788846144.539261:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702457600 00000100:00100000:3.0:1788846144.539294:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702457728 00000100:00100000:3.0:1788846144.539297:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702457728 00000100:00100000:3.0:1788846144.539310:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846144.539318:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:17104:x1875740702457600:12345-0@lo:104: 00010000:00010000:3.0:1788846144.539330:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.539397:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788846144.539397:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:18591:x1875740702457472:12345-0@lo:253:mount.lustre.0 Request processed in 8915us (9414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846144.539402:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:17104:x1875740702457600:12345-0@lo:104: Request processed in 86us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.539406:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788846144.539407:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846144.539422:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788846144.539427:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46e4a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:17104:x1875740702457728:12345-0@lo:104: 00010000:00010000:3.0:1788846144.539434:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539434:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846144.539439:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539446:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065000 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846144.539450:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539459:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846144.539461:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846144.539465:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46e4a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:17104:x1875740702457728:12345-0@lo:104: Request processed in 39us (284us total) trans 0 rc 0/0 10000000:00010000:2.0:1788846144.539467:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846144.539471:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:2.0:1788846144.539473:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788846144.539503:0:17844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539509:0:17844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846144.539544:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846144.539546:0:18591:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:18591:1875740702457472:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1788846144.539551:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475065000/0x21b4d56138272c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c4f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846144.539556:0:18591:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788846144.539559:0:18591:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788846144.539560:0:18591:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788846144.539562:0:18591:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:2.0:1788846144.539562:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:3.0:1788846144.539563:0:18591:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846144.539565:0:18591:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:2.0:1788846144.539565:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788846144.539566:0:18591:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846144.539567:0:18591:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846144.539569:0:18591:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846144.539570:0:18591:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1788846144.539576:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356400 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846144.539578:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1788846144.539582:0:18591:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788846144.539585:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846144.539591:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846144.539595:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788846144.539608:0:17844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539613:0:17844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846144.539625:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539630:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272c3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c41 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539642:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846144.539644:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846144.539645:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846144.539651:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846144.539733:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702457856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846144.539762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.539791:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702457984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846144.539824:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846144.539862:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702457856 00000100:00100000:2.0:1788846144.539866:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702457856 00010000:00010000:2.0:1788846144.539883:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c48 expref: 21 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846144.539900:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702457984 00000100:00100000:2.0:1788846144.539903:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702457984 00010000:00010000:2.0:1788846144.539913:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c3a expref: 22 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846144.539925:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788846144.539931:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:3641:x1875740702457856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846144.539940:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846144.539944:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c48 expref: 22 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539952:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272c48 expref: 22 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.539966:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846144.539993:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:3641:x1875740702457856:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.539999:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788846144.540011:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846144.540016:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f27e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3642:x1875740702457984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846144.540023:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846144.540027:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c3a expref: 21 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540046:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272c3a expref: 21 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540057:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540064:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788846144.540076:0:17074:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002940532s 00010000:00010000:2.0:1788846144.540080:0:17074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540087:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540094:0:17074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540100:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540105:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846144.540109:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540116:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540124:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846144.540137:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788846144.540799:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e441356600/0x21b4d56138272c4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272c48 expref: 21 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846144.540813:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702457600:0@lo:104: 00010000:00010000:1.0:1788846144.540824:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42cc00/0x21b4d56138272c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272c3a expref: 20 pid: 17080 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846144.540833:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702457728:0@lo:104: 00010000:00010000:1.0:1788846144.540851:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.540860:0:17104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.540866:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846144.540883:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272cf7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846144.541029:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f27e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:3642:x1875740702457984:12345-0@lo:103:ldlm_bl.0 Request processed in 1011us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846144.541037:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846144.541093:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702457856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846144.541112:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702457984:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788846144.543119:0:18591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788846144.550248:0:18591:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788846144.550255:0:18591:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788846144.550284:0:18591:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788846144.550326:0:18591:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788846144.550343:0:18591:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788846144.550354:0:18591:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788846144.551962:0:18591:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788846144.553268:0:18591:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788846145.222118:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788846145.421824:0:18672:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788846145.422093:0:18672:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788846146.105715:0:17086:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846146.105724:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e475188800 from 9 10000000:01000000:0.0:1788846146.105728:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846146.105778:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846146.105790:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846146.105812:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846146.105846:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702458112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846146.105921:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846146.105985:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450c7a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788846146.106013:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702458112 00000100:00100000:1.0:1788846146.106021:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702458112 00000100:00100000:1.0:1788846146.106081:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788846146.106091:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+19:17086:x1875740702458112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846146.106104:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846146.106117:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272cfe expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846146.106139:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272cfe expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846146.106149:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272cfe expref: 20 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846146.106158:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2600, rc 0) 00000100:00100000:1.0:1788846146.106216:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:17086:x1875740702458112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846146.106222:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788846146.106319:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702458112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846146.106334:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846146.106343:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846146.106391:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702458240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788846146.106423:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846146.106444:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449be3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788846146.106777:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702458240 00000100:00100000:0.0:1788846146.106782:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702458240 00000100:00100000:0.0:1788846146.106818:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788846146.106826:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:17086:x1875740702458240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788846146.106958:0:17083:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788846146.106977:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788846146.106979:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788846146.107071:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:17086:x1875740702458240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 246us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846146.107079:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788846146.107171:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702458240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788846146.107246:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788846146.107253:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846146.107263:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846146.107277:0:17086:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788846146.107279:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e344550800 from 9 10000000:01000000:2.0:1788846146.107282:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788846146.107301:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846146.107307:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846146.107314:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846146.107328:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702458368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846146.107355:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846146.107385:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449be3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788846146.107559:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702458368 00000100:00100000:3.0:1788846146.107565:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702458368 00000100:00100000:3.0:1788846146.107601:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788846146.107608:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:17086:x1875740702458368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846146.107617:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846146.107628:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272d0c expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846146.107646:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272d0c expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846146.107656:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272d0c expref: 21 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846146.107663:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065600, rc 0) 00000100:00100000:3.0:1788846146.107702:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702458368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846146.107708:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788846146.107824:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702458368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846146.107835:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846146.107843:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846146.107883:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702458496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788846146.107911:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846146.107927:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e449be3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788846146.108110:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702458496 00000100:00100000:0.0:1788846146.108115:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702458496 00000100:00100000:0.0:1788846146.108148:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788846146.108155:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702458496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788846146.108168:0:17083:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788846146.108192:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788846146.108195:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788846146.108273:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702458496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846146.108282:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788846146.108354:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702458496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788846146.108397:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788846146.108406:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846146.108414:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846146.237030:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846147.258682:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846147.644353:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788846148.283735:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846149.305754:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846149.438838:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702458624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846149.438915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846149.438983:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702458624 00000100:00100000:2.0:1788846149.438990:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702458624 00000100:00100000:2.0:1788846149.439250:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846149.439264:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702458624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846149.439298:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788846149.439344:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702458624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846149.439351:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846149.439399:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702458624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846149.440566:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702458752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788846149.440615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846149.440694:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702458752 00000100:00100000:3.0:1788846149.440701:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702458752 00000100:00100000:3.0:1788846149.440736:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788846149.440744:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702458752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788846149.440771:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788846149.446578:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702458752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5823us (5950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846149.446599:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846149.449802:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702458752:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788846149.945648:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846149.945656:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846149.945659:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846149.945662:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846149.945683:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846149.945694:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788846149.945697:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846149.945700:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846149.945757:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702459264:0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.945817:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846149.945854:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788846149.945859:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702458880:0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.945887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846149.945913:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702459392:0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.945933:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846149.945957:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702459008:0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.945978:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846149.945994:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788846149.945999:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3445d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702459136:0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.946019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846149.946063:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702459264 00000100:00100000:2.0:1788846149.946070:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702459264 00000100:00100000:2.0:1788846149.946110:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702459392 00000100:00100000:2.0:1788846149.946113:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702459392 00000100:00100000:2.0:1788846149.946123:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702459008 00000100:00100000:2.0:1788846149.946125:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702459008 00000100:00100000:2.0:1788846149.946135:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702459136 00000100:00100000:2.0:1788846149.946138:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702459136 00000100:00100000:2.0:1788846149.946151:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846149.946172:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702459264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.946219:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702459264:12345-0@lo:400:kworker.0 Request processed in 48us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846149.946232:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788846149.946248:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846149.946253:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702459392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.946281:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702459392:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846149.946287:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788846149.946297:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846149.946302:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702459008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.946330:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702459008:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846149.946336:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846149.946347:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846149.946352:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702459136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.946374:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702459136:12345-0@lo:400:kworker.0 Request processed in 22us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846149.946380:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846149.946396:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702458880 00000100:00100000:2.0:1788846149.946399:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702458880 00000100:00100000:2.0:1788846149.946422:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788846149.946440:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3640:x1875740702458880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.946467:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3640:x1875740702458880:12345-0@lo:400:kworker.0 Request processed in 39us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846149.946473:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788846149.946543:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d4000 x1875740702459136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846149.946568:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702459136:0@lo:400:kworker.0 00010000:00080000:2.0:1788846149.946581:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d5f80 x1875740702459008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846149.946589:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702459008:0@lo:400:kworker.0 00000100:00100000:2.0:1788846149.946616:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702458880:0@lo:400:kworker.0 00010000:00080000:2.0:1788846149.946626:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d5500 x1875740702459392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846149.946633:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702459392:0@lo:400:kworker.0 00010000:00080000:2.0:1788846149.946641:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e3445d4380 x1875740702459264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846149.946648:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3445d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702459264:0@lo:400:kworker.0 00000100:00080000:3.0:1788846149.946897:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788846149.946901:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788846150.334679:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788846150.398899:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788846150.941985:0:18961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788846151.361401:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788846151.847448:0:19013:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788846151.847762:0:19013:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788846152.378745:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788846152.774009:0:19064:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846152.774271:0:19064:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788846153.401867:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846153.721616:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846138/real 1788846138] req@ffff90e47d3b0a80 x1875740702452096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846153 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.721651:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e47d3b0a80 x1875740702452096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846153 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.721662:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846138/real 1788846138] req@ffff90e47d3b3800 x1875740702452224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846153 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.721675:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e47d3b3800 x1875740702452224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846153 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788846153.721696:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846153.721740:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788846153.721745:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702452096:0@lo:8:kworker.0 00000100:00080000:2.0:1788846153.721751:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846153.721756:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788846153.721759:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702452224:0@lo:8:kworker.0 00000100:00080000:1.0:1788846153.721912:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846153.721922:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846153.721925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846153.721928:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788846153.721960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846153.721964:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788846153.721967:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e44314c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846153.721971:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 522 00000100:00080000:1.0:1788846153.721976:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788846153.721982:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90e44314c000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846153.722000:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344574e00 x1875740702460032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788846153.722012:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788846153.722015:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788846153.722016:0:37:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788846153.722035:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 522 00000100:00080000:1.0:1788846153.722038:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788846153.722042:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e446110000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:1.0:1788846153.722054:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344575500 x1875740702460160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846153.722142:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702459520:0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.722252:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702460288:0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722278:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.722308:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788846153.722316:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702459648:0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722341:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.722359:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702460416:0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722380:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.722413:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702459776:0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722436:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.722453:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702460544:0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722473:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.722489:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846153.722494:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702459904:0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.722570:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702460288 00000100:00100000:2.0:1788846153.722577:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702460288 00000100:00100000:2.0:1788846153.722609:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702460416 00000100:00100000:2.0:1788846153.722612:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702460416 00000100:00100000:2.0:1788846153.722647:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702459776 00000100:00100000:2.0:1788846153.722650:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702459776 00000100:00100000:2.0:1788846153.722662:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702460544 00000100:00100000:2.0:1788846153.722664:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702460544 00000100:00100000:2.0:1788846153.722680:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846153.722687:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702460288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722733:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702460288:12345-0@lo:400:kworker.0 Request processed in 46us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846153.722741:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846153.722757:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788846153.722763:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702460416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722790:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702460416:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846153.722795:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788846153.722805:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788846153.722810:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702459776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722836:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702459776:12345-0@lo:400:kworker.0 Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846153.722841:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788846153.722851:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788846153.722857:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702460544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722878:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702460544:12345-0@lo:400:kworker.0 Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846153.722883:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788846153.722901:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702459648 00000100:00100000:2.0:1788846153.722905:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702459648 00000100:00100000:2.0:1788846153.722926:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702459904 00000100:00100000:2.0:1788846153.722936:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702459904 00000100:00100000:2.0:1788846153.722951:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846153.722957:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702459648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.722989:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3445d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702459648:12345-0@lo:400:kworker.0 Request processed in 32us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846153.722996:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846153.723008:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788846153.723014:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702459904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.723040:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702459904:12345-0@lo:400:kworker.0 Request processed in 27us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846153.723045:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788846153.723068:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788846153.723072:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846153.723098:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702459904:0@lo:400:kworker.0 00010000:00080000:2.0:1788846153.723110:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344576a00 x1875740702459776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.723120:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702459776:0@lo:400:kworker.0 00010000:00080000:2.0:1788846153.723143:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344576300 x1875740702460544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.723151:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702460544:0@lo:400:kworker.0 00000100:00100000:2.0:1788846153.723178:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702460032:0@lo:8:kworker.0 00000100:00100000:2.0:1788846153.723205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.723228:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702460160:0@lo:8:kworker.0 00000100:00100000:2.0:1788846153.723246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.723287:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702459648:0@lo:400:kworker.0 00010000:00080000:2.0:1788846153.723297:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344576680 x1875740702460416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.723304:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702460416:0@lo:400:kworker.0 00010000:00080000:2.0:1788846153.723313:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344575880 x1875740702460288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.723319:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702460288:0@lo:400:kworker.0 00000100:00100000:1.0:1788846153.723393:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702459520 00000100:00100000:1.0:1788846153.723398:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702459520 00000100:00100000:1.0:1788846153.723431:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788846153.723438:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45356a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3642:x1875740702459520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846153.723475:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45356a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3642:x1875740702459520:12345-0@lo:400:kworker.0 Request processed in 38us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846153.723488:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788846153.723551:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702460032 00000100:00100000:1.0:1788846153.723555:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702460032 00000100:00100000:1.0:1788846153.723568:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702460160 00000100:00100000:1.0:1788846153.723571:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702460160 00000100:00100000:1.0:1788846153.723579:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788846153.723583:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702460032:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788846153.723606:0:18597:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1788846153.723630:0:18597:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138272d1a 00002000:00100000:1.0:1788846153.723643:0:18597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90e468fb0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788846153.723647:0:18597:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788846153.723649:0:18597:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788846153.723797:0:18597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788846153.723818:0:18597:0:(import.c:65:import_set_state_nolock()) ffff90e468fb2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846153.723857:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702460032:12345-0@lo:8:kworker.0 Request processed in 272us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846153.723863:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788846153.723875:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846153.723879:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702460160:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788846153.723890:0:18597:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788846153.728989:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702459520:0@lo:400:kworker.0 00010000:00080000:3.0:1788846153.736695:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344574e00 x1875740702460032/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846153.736711:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788846153.736721:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788846153.736732:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788846153.736737:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788846153.736741:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788846153.736770:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788846153.736777:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702460032:0@lo:8:kworker.0 00000004:00080000:2.0:1788846153.737113:0:17830:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788846153.737222:0:17830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 537774701220ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788846153.737229:0:17830:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788846153.742193:0:17831:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788846153.742231:0:17831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1875740702460800:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788846153.742300:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846153.742332:0:17831:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e445158600 going to sleep for 11 seconds 00000100:00100000:1.0:1788846153.742351:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702460672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788846153.742388:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846153.742435:0:18595:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788846153.742443:0:18595:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788846153.742514:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702460160:12345-0@lo:8:kworker.0 Request processed in 18632us (19265us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788846153.742558:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846153.742733:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702460800 00000100:00100000:1.0:1788846153.742740:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702460800 00000100:00080000:1.0:1788846153.742767:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846153.743125:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788846153.743148:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17831:x1875740702460800:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:3.0:1788846153.743428:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788846153.743435:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788846153.743439:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702460160:0@lo:8:kworker.0 00000100:00100000:1.0:1788846153.743620:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702460672 00000100:00100000:1.0:1788846153.743626:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702460672 00000100:00100000:1.0:1788846153.743665:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788846153.743670:0:18600:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788846153.743675:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875740702460672:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846153.743682:0:18600:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788846153.743696:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788846153.743748:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875740702460672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846153.743754:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788846153.744575:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344574e00 x1875740702460672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846153.744597:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702460672:0@lo:13:osp-pre-0-1.0 00002000:00080000:3.0:1788846153.746042:0:18598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788846153.746050:0:18598:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788846153.746458:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17831:x1875740702460800:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3309us (4154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846153.746472:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:2.0:1788846153.746874:0:17821:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:1.0:1788846153.750428:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344574380 x1875740702460800/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788846169 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846153.750448:0:17831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1875740702460800:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788846153.750463:0:17831:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788846153.750511:0:17831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1875740702460928:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788846153.750593:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846153.750625:0:17831:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e445158600 going to sleep for 11 seconds 00000100:00100000:0.0:1788846153.750705:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702460928 00000100:00100000:0.0:1788846153.750712:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702460928 00000100:00100000:0.0:1788846153.751322:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788846153.751334:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17831:x1875740702460928:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788846153.751364:0:18597:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788846153.751419:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17831:x1875740702460928:12345-0@lo:5:osp-pre-0-1.0 Request processed in 89us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846153.751427:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788846153.752667:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e344574380 x1875740702460928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788846169 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.752683:0:17831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1875740702460928:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788846153.752695:0:17831:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788846153.752735:0:17831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1875740702461056:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788846153.752780:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.752927:0:17831:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70780 going to sleep for 11 seconds 00000100:00100000:1.0:1788846153.752963:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702461056 00000100:00100000:1.0:1788846153.752969:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702461056 00000100:00100000:1.0:1788846153.753042:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788846153.753051:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17831:x1875740702461056:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788846153.753084:0:18595:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:1.0:1788846153.764812:0:18592:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788846153.764824:0:18592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788846153.765098:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17831:x1875740702461056:12345-0@lo:5:osp-pre-0-1.0 Request processed in 12044us (12313us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788846153.765109:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788846153.765282:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e343a39f80 x1875740702461056/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788846169 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.765294:0:17831:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788846153.765301:0:17831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17831:1875740702461056:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788846153.765316:0:17831:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788846153.765372:0:17831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17831:1875740702461184:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788846153.765420:0:17831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846153.765450:0:17831:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e442e70780 going to sleep for 11 seconds 00000100:00100000:1.0:1788846153.765514:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702461184 00000100:00100000:1.0:1788846153.765551:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702461184 00000100:00100000:1.0:1788846153.765596:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846153.765606:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17831:x1875740702461184:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788846153.765653:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17831:x1875740702461184:12345-0@lo:900:osp-pre-0-1.0 Request processed in 49us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846153.765660:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788846153.766009:0:17831:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e343a39f80 x1875740702461184/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788846169 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846153.766019:0:17831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17831:1875740702461184:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788846154.425771:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846154.553900:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788846154.553921:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702461312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846154.553985:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846154.554038:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702461312 00000100:00100000:1.0:1788846154.554045:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702461312 00000100:00100000:1.0:1788846154.554087:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788846154.554096:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702461312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846154.554141:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846154.554185:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702461312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846154.554201:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788846154.554259:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702461312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846154.557819:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846154.564847:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702461440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846154.564933:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846154.570766:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702461440 00000100:00100000:1.0:1788846154.570782:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702461440 00000100:00100000:1.0:1788846154.570857:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788846154.570869:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702461440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846154.570923:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788846154.571287:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702461440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 420us (6352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846154.571294:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788846154.571405:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702461440:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788846155.455230:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846156.479700:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846157.502003:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846157.884121:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788846158.525061:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846159.162838:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702461568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788846159.162922:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.163698:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788846159.163708:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702461696:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.163749:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.163792:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702461568 00000100:00100000:1.0:1788846159.163799:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702461568 00000100:00100000:2.0:1788846159.164754:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702461696 00000100:00100000:2.0:1788846159.164765:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702461696 00000100:00100000:2.0:1788846159.164817:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788846159.164828:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e446729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3640:x1875740702461696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846159.164906:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e446729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3640:x1875740702461696:12345-0@lo:400:kworker.0 Request processed in 80us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.164913:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788846159.165317:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788846159.165328:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702461568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788846159.165351:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788846159.165387:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702461568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.165393:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788846159.166186:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846159.166226:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702461696:0@lo:400:kworker.0 00010000:00080000:1.0:1788846159.166244:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e343a39f80 x1875740702461568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846159.166263:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702461568:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788846159.166822:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846159.166827:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846159.166829:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846159.166832:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846159.166860:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846159.166864:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788846159.166867:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788846159.166873:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:3.0:1788846159.166877:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788846159.166882:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e446110000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:3.0:1788846159.166901:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47f4ed880 x1875740702462208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788846159.166989:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702462208:0@lo:8:kworker.0 00000100:00100000:1.0:1788846159.167057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.167108:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702462080:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.167134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.167153:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788846159.167158:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702462336:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.167179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.167206:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702462080 00000100:00100000:1.0:1788846159.167214:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702462080 00000100:00100000:1.0:1788846159.167251:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788846159.167259:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702462080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.167304:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702462080:12345-0@lo:400:kworker.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.167311:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788846159.167331:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702462336 00000100:00100000:1.0:1788846159.167334:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702462336 00000100:00100000:1.0:1788846159.167357:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788846159.167363:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702462336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.167390:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702462336:12345-0@lo:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.167396:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788846159.167441:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47f4ef800 x1875740702462336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846159.167453:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702462336:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.167462:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702462080:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.168268:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702461952:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.168305:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.168336:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702462592:0@lo:400:kworker.0 00000100:00100000:0.0:1788846159.168350:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702461952 00000100:00100000:0.0:1788846159.168356:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702461952 00000100:00100000:1.0:1788846159.168360:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.168379:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788846159.168383:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702462592 00000100:00100000:1.0:1788846159.168385:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702461824:0@lo:400:kworker.0 00000100:00100000:0.0:1788846159.168386:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702462592 00000100:00100000:1.0:1788846159.168407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846159.168414:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788846159.168421:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702461952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.168422:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702462464:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.168446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846159.168458:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875740702461952:12345-0@lo:400:kworker.0 Request processed in 39us (154us total) trans 0 rc 0/0 00010000:00080000:1.0:1788846159.168465:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47f4ed500 x1875740702461952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846159.168465:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788846159.168474:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875740702461952:0@lo:400:kworker.0 00000100:00100000:0.0:1788846159.168476:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702462464 00000100:00100000:0.0:1788846159.168479:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702462464 00000100:00100000:0.0:1788846159.168493:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788846159.168499:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702462592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.168500:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788846159.168505:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702462464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846159.168549:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702462592:12345-0@lo:400:kworker.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846159.168556:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788846159.168572:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788846159.168575:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788846159.168599:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47f4ef480 x1875740702462592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846159.168609:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702462592:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.168680:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875740702462464:12345-0@lo:400:kworker.0 Request processed in 174us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.168687:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788846159.168704:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702461824 00000100:00100000:1.0:1788846159.168708:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702461824 00000100:00100000:1.0:1788846159.168730:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788846159.168744:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702461824:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788846159.168749:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90e47f4eca80 x1875740702462464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846159.168757:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3643:1875740702462464:0@lo:400:kworker.0 00000100:00100000:1.0:1788846159.168796:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702461824:12345-0@lo:400:kworker.0 Request processed in 53us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.168803:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788846159.168867:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702461824:0@lo:400:kworker.0 00000100:00100000:0.0:1788846159.169584:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702462208 00000100:00100000:0.0:1788846159.169590:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702462208 00000100:00100000:0.0:1788846159.169621:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846159.169637:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1875740702462208:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788846159.169656:0:19094:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788846159.184233:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3639:x1875740702462208:12345-0@lo:8:kworker.0 Request processed in 14587us (17182us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788846159.184248:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788846159.184333:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846159.184339:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788846159.184343:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702462208:0@lo:8:kworker.0 00000020:01000004:2.0:1788846159.364617:0:19411:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788846159.364621:0:19411:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788846159.364705:0:19411:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788846159.364811:0:19411:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90e344565000 00000020:01000004:2.0:1788846159.364826:0:19411:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788846159.364840:0:19411:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788846159.364855:0:19411:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90e47b688000) 00000020:00000080:2.0:1788846159.364873:0:19411:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788846159.428319:0:19411:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788846159.432476:0:19411:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788846159.433348:0:19411:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788846159.433904:0:19411:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788846159.434500:0:19411:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788846159.434791:0:19411:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788846159.435062:0:19411:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788846159.438648:0:19411:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788846159.438857:0:19411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788846159.438871:0:19411:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788846159.438883:0:19411:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21b4d56138272d28 00000020:01000004:3.0:1788846159.438890:0:19411:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788846159.438913:0:19411:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788846159.438916:0:19411:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788846159.438922:0:19411:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788846159.438949:0:19411:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788846159.438953:0:19411:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788846159.463199:0:19411:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788846159.463240:0:19411:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.120@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788846159.463245:0:19411:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788846159.463247:0:19411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788846159.463248:0:19411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846159.463250:0:19411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846159.463251:0:19411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846159.463253:0:19411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846159.463254:0:19411:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846159.463256:0:19411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846159.463257:0:19411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846159.463261:0:19411:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788846159.463263:0:19411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788846159.463265:0:19411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788846159.463266:0:19411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846159.463267:0:19411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846159.463268:0:19411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846159.463270:0:19411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846159.463271:0:19411:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846159.463272:0:19411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846159.463273:0:19411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788846159.463297:0:19411:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788846159.463320:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702462720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788846159.463398:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.463441:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469a71b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846159.463567:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702462720 00000100:00100000:1.0:1788846159.463574:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702462720 00000100:00100000:1.0:1788846159.463634:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788846159.463644:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e446728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:19411:x1875740702462720:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788846159.463683:0:17082:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788846159.463686:0:17082:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788846159.463690:0:17082:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788846159.465811:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e446728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:19411:x1875740702462720:12345-0@lo:253:mount.lustre.0 Request processed in 2161us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.465825:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788846159.466703:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702462720:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788846159.466719:0:19411:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788846159.466722:0:19411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788846159.466724:0:19411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788846159.466725:0:19411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788846159.466726:0:19411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788846159.466727:0:19411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788846159.466728:0:19411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788846159.466730:0:19411:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788846159.466732:0:19411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788846159.466733:0:19411:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788846159.466757:0:19411:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90e344565000 from lustre-OST0001 10000000:01000000:3.0:1788846159.466792:0:19411:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788846159.466795:0:19411:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788846159.466805:0:19411:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90e34265b370 local copy 00010000:00010000:3.0:1788846159.466816:0:19411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846159.467235:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702462848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846159.467297:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846159.467341:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846159.467801:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702462848 00000100:00100000:1.0:1788846159.467809:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702462848 00000100:00100000:1.0:1788846159.468053:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788846159.469381:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44672ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:19411:x1875740702462848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846159.470747:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44672ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:19411:x1875740702462848:12345-0@lo:501:mount.lustre.0 Request processed in 2679us (3442us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788846159.470759:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788846159.470994:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702462848:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788846159.471034:0:19411:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788846159.471649:0:19411:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788846159.471660:0:19411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.471675:0:19411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441357800/0x21b4d56138272a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272a49 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846159.471711:0:19411:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90e344565000 10000000:01000000:3.0:1788846159.471717:0:19411:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788846159.471722:0:19411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788846159.471725:0:19411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788846159.471729:0:19411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788846159.471732:0:19411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788846159.471764:0:19411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.471772:0:19411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.471782:0:19411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846159.471803:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702462976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788846159.472628:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846159.472687:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846159.472947:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702462976 00000100:00100000:1.0:1788846159.472955:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702462976 00000100:00100000:1.0:1788846159.473150:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788846159.473160:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44672a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:19411:x1875740702462976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788846159.473186:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846159.473202:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272d2f expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.473227:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272d2f expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.473237:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2a00/0x21b4d56138272d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272d2f expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.473245:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2a00, rc 0) 00000100:00100000:1.0:1788846159.473300:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44672a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702462976:12345-0@lo:101:mount.lustre.0 Request processed in 141us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.473307:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788846159.474385:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702462976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846159.474405:0:19411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.474428:0:19411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846159.479506:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788846159.480310:0:19411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846159.485016:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788846159.485642:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788846159.485665:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788846159.485680:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788846159.485693:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788846159.485707:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788846159.485734:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788846159.485739:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788846159.486006:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846159.489211:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846159.489271:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846159.489704:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702463104 00000100:00100000:1.0:1788846159.489714:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702463104 00000100:00100000:1.0:1788846159.489774:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788846159.489783:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788846159.489967:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463104:12345-0@lo:501:mount.lustre.0 Request processed in 185us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.489975:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788846159.490197:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846159.490245:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788846159.490300:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846159.490331:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788846159.490388:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702463232 00000100:00100000:0.0:1788846159.490393:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702463232 00000100:00100000:0.0:1788846159.490427:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788846159.490435:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846159.491395:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463232:12345-0@lo:503:mount.lustre.0 Request processed in 957us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846159.491404:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788846159.491509:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463232:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788846159.491961:0:19411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788846159.492033:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788846159.492087:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846159.492130:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788846159.492302:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702463360 00000100:00100000:1.0:1788846159.492307:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702463360 00000100:00100000:1.0:1788846159.492346:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788846159.492355:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846159.493325:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463360:12345-0@lo:502:mount.lustre.0 Request processed in 966us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.493346:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788846159.494464:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788846159.501492:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788846159.501549:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788846159.501566:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788846159.501580:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788846159.503834:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788846159.503862:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788846159.503875:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788846159.505769:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788846159.505790:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788846159.505841:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846159.506068:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.506117:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846159.506225:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702463488 00000100:00100000:0.0:1788846159.506232:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702463488 00000100:00100000:0.0:1788846159.506284:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788846159.506293:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846159.506415:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463488:12345-0@lo:502:mount.lustre.0 Request processed in 122us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846159.506423:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788846159.506460:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788846159.506515:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788846159.506627:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788846159.518753:0:19415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788846159.518772:0:19415:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788846159.518780:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.518782:0:19415:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788846159.518794:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788846159.518810:0:19415:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90e449bdb370) 00000020:00000080:0.0:1788846159.518835:0:19415:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788846159.518841:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788846159.518926:0:19415:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e344565000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788846159.518935:0:19415:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788846159.518941:0:19415:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x21b4d56138272d44 00010000:00010000:1.0:1788846159.536489:0:19415:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788846159.538854:0:19415:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788846159.541974:0:19415:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00010000:00010000:1.0:1788846159.547700:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788846159.549203:0:19415:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788846159.549216:0:19415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846159.549223:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846159.549225:0:19415:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788846159.549228:0:19415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846159.549232:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846159.549234:0:19415:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788846159.549236:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788846159.549238:0:19415:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788846159.549240:0:19415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846159.549242:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846159.549243:0:19415:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788846159.549245:0:19415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788846159.549248:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846159.549249:0:19415:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788846159.549252:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788846159.549277:0:19415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788846159.549280:0:19415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788846159.549281:0:19415:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788846159.549284:0:19415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788846159.556228:0:19411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788846159.556276:0:19411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788846159.556295:0:19411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.556307:0:19411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475064e00/0x21b4d56138272d2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d36 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846159.556315:0:19411:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e344565000 from 1 10000000:01000000:1.0:1788846159.556317:0:19411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788846159.556357:0:19411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.556364:0:19411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.556376:0:19411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846159.556399:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788846159.556469:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.556515:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788846159.556569:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702463616 00000100:00100000:3.0:1788846159.556578:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702463616 00000100:00100000:3.0:1788846159.556643:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788846159.556652:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:19411:x1875740702463616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846159.556667:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846159.556681:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272d4b expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.556721:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272d4b expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.556732:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272d4b expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.556741:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475064c00, rc 0) 00000100:00100000:3.0:1788846159.556921:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702463616:12345-0@lo:101:mount.lustre.0 Request processed in 269us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846159.556928:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788846159.557214:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788846159.557230:0:19411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846159.557240:0:19411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788846159.559707:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788846159.560388:0:19411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788846159.561351:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788846159.561379:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788846159.561396:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788846159.561401:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788846159.561480:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846159.561559:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846159.564973:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495410c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846159.565313:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702463744 00000100:00100000:3.0:1788846159.565324:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702463744 00000100:00100000:3.0:1788846159.565378:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788846159.565388:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702463744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788846159.565580:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702463744:12345-0@lo:501:mount.lustre.0 Request processed in 193us (4021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846159.565597:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788846159.565709:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846159.565772:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788846159.565828:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846159.565865:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495410c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846159.566649:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702463872 00000100:00100000:2.0:1788846159.566658:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702463872 00000100:00100000:2.0:1788846159.566706:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788846159.566714:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702463872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846159.566841:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702463872:12345-0@lo:503:mount.lustre.0 Request processed in 127us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.566849:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788846159.567113:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702463872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788846159.567514:0:19411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788846159.567636:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846159.567685:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846159.567725:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846159.568018:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702464000 00000100:00100000:2.0:1788846159.568024:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702464000 00000100:00100000:2.0:1788846159.568071:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788846159.568080:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702464000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846159.568184:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702464000:12345-0@lo:502:mount.lustre.0 Request processed in 106us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.568191:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788846159.568433:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846159.568707:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788846159.568737:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788846159.568823:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788846159.568837:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788846159.568848:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788846159.568862:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788846159.568875:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788846159.568995:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788846159.569010:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788846159.569025:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788846159.569038:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788846159.569203:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846159.569267:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846159.569355:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450fa0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788846159.569492:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702464128 00000100:00100000:2.0:1788846159.569499:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702464128 00000100:00100000:2.0:1788846159.569560:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788846159.569568:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702464128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846159.569673:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702464128:12345-0@lo:502:mount.lustre.0 Request processed in 105us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.569680:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788846159.571323:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846159.571466:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788846159.571479:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788846159.572475:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846159.572487:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.572489:0:19419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788846159.572498:0:19419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e344565000 00000020:00000080:0.0:1788846159.572507:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846159.572516:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846159.572579:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.572582:0:19419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788846159.572951:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846159.572957:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.572959:0:19419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788846159.572962:0:19419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90e344565000 00000020:00000080:0.0:1788846159.572965:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846159.573024:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846159.573028:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.573030:0:19419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788846159.573033:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846159.573035:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.573036:0:19419:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846159.573040:0:19419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e344565000 00000020:00000080:0.0:1788846159.573041:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846159.573672:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846159.573679:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.573680:0:19419:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788846159.573684:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788846159.573687:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.573688:0:19419:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788846159.573691:0:19419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90e344565000 00000020:00000080:0.0:1788846159.573693:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788846159.573731:0:19419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788846159.573734:0:19419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788846159.573735:0:19419:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788846159.573739:0:19419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788846159.574192:0:19411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788846159.575187:0:19411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846159.575213:0:19411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.575232:0:19411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846159.575291:0:19411:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788846159.575294:0:19411:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90e344565000 10000000:01000000:2.0:1788846159.575297:0:19411:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90e344565000 10000000:01000000:2.0:1788846159.575301:0:19411:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788846159.575306:0:19411:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90e344565000 from 1 10000000:01000000:2.0:1788846159.575309:0:19411:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788846159.575343:0:19411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.575351:0:19411:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.575362:0:19411:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846159.575388:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464256:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788846159.575458:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.575505:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846159.575513:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702464256 00000100:00100000:3.0:1788846159.575535:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702464256 00000100:00100000:3.0:1788846159.575619:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788846159.575628:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:19411:x1875740702464256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788846159.575642:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846159.575655:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e475065400/0x21b4d56138272d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272d59 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.575677:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e475065400/0x21b4d56138272d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272d59 expref: 24 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.575699:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e475065400/0x21b4d56138272d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272d59 expref: 24 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846159.575707:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e475065400, rc 0) 00000100:00100000:3.0:1788846159.575745:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464256:12345-0@lo:101:mount.lustre.0 Request processed in 119us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846159.575752:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788846159.576054:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788846159.576148:0:19411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.576159:0:19411:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788846159.583296:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788846159.583735:0:19411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788846159.584013:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788846159.584038:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788846159.584052:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788846159.584148:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788846159.584165:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788846159.584178:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788846159.584190:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788846159.584202:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788846159.584215:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788846159.584226:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788846159.584238:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788846159.584250:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788846159.584262:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788846159.584276:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788846159.584290:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788846159.584302:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788846159.584314:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788846159.584327:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788846159.584339:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788846159.584365:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788846159.584380:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788846159.584393:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788846159.584406:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788846159.584418:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788846159.584430:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788846159.584444:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788846159.584457:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788846159.584469:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788846159.584483:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788846159.584505:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788846159.589488:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788846159.589571:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788846159.589602:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788846159.589618:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788846159.589633:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788846159.589662:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788846159.589677:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788846159.589690:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788846159.589704:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788846159.589718:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788846159.589732:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788846159.589746:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788846159.589874:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788846159.589895:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788846159.589910:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788846159.589923:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788846159.589948:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788846159.589954:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788846159.590056:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846159.590131:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.590178:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788846159.595231:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702464384 00000100:00100000:0.0:1788846159.595243:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702464384 00000100:00100000:0.0:1788846159.595301:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788846159.595311:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788846159.595494:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464384:12345-0@lo:501:mount.lustre.0 Request processed in 185us (5363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846159.595502:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788846159.595509:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788846159.595573:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464512:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788846159.596462:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.596580:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788846159.600504:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702464512 00000100:00100000:0.0:1788846159.600542:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702464512 00000100:00100000:1.0:1788846159.607306:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788846159.607318:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788846159.607479:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464512:12345-0@lo:503:mount.lustre.0 Request processed in 163us (11020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.607487:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788846159.608622:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464512:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788846159.609250:0:19411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788846159.609340:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846159.609410:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846159.609458:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e341d4ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788846159.609481:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702464640 00000100:00100000:0.0:1788846159.609487:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702464640 00000100:00100000:0.0:1788846159.609556:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788846159.609564:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846159.609735:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464640:12345-0@lo:502:mount.lustre.0 Request processed in 171us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846159.609743:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788846159.609864:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788846159.610054:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788846159.610718:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788846159.610734:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788846159.610746:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788846159.611150:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788846159.611168:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788846159.611181:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788846159.611191:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788846159.611202:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788846159.611225:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788846159.611236:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788846159.611264:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788846159.611278:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788846159.611289:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788846159.611302:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788846159.611314:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788846159.611326:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788846159.611339:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788846159.611350:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788846159.611361:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788846159.611372:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788846159.611384:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788846159.611395:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788846159.611408:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788846159.611421:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788846159.611435:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788846159.611449:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788846159.611477:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788846159.611493:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788846159.611507:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788846159.611546:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788846159.611562:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788846159.611575:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788846159.612710:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788846159.612741:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788846159.612923:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788846159.612942:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788846159.612956:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788846159.612969:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788846159.612982:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788846159.612994:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788846159.613006:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788846159.613027:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788846159.613051:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788846159.613143:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788846159.613158:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788846159.613171:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788846159.613183:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788846159.613233:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846159.613304:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846159.613379:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788846159.619384:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702464768 00000100:00100000:2.0:1788846159.619397:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702464768 00000100:00100000:2.0:1788846159.619452:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788846159.619462:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788846159.620073:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464768:12345-0@lo:502:mount.lustre.0 Request processed in 610us (6766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.620082:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788846159.627175:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846159.627419:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788846159.627448:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788846159.627488:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788846159.628967:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.629797:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846159.630229:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702464896 00000100:00100000:0.0:1788846159.630239:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702464896 00000100:00100000:0.0:1788846159.630336:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788846159.630348:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788846159.630504:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702464896:12345-0@lo:502:mount.lustre.0 Request processed in 158us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846159.630512:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788846159.630647:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702464896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788846159.630724:0:19411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788846159.630737:0:19411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788846159.633242:0:19425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788846159.633259:0:19425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90e474c78000) 00000020:00000080:1.0:1788846159.633282:0:19425:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788846159.633365:0:19425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e344565000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788846159.633369:0:19425:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e344565000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788846159.633371:0:19425:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e344565000 3 00010000:00080000:1.0:1788846159.633406:0:19425:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e46e21a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846159.637299:0:19425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788846159.637595:0:19425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788846159.637644:0:19425:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788846159.637657:0:19425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x21b4d56138272d6e 00000100:00080000:0.0:1788846159.637678:0:19425:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846159.637685:0:19425:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90e46e21a800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846159.637721:0:19425:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b3100 x1875740702465024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846159.637739:0:19425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788846159.637781:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846159.637786:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788846159.637789:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788846159.637792:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846159.637949:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702465024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846159.638017:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.638191:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702465024 00000100:00100000:2.0:1788846159.638198:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702465024 00000100:00100000:2.0:1788846159.638232:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788846159.638240:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3639:x1875740702465024:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788846159.638260:0:17089:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1788846159.638300:0:17089:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x21b4d56138272d75 00000004:00100000:2.0:1788846159.638316:0:17089:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788846159.638347:0:17089:0:(import.c:65:import_set_state_nolock()) ffff90e342707800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846159.638395:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1875740702465024:12345-0@lo:38:llog_process_th.0 Request processed in 155us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.638402:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788846159.638437:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b3100 x1875740702465024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846159.638447:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846159.638456:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788846159.638464:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788846159.638467:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788846159.638470:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e46e21a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788846159.638475:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3639:1875740702465024:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788846159.640290:0:19425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788846159.640306:0:19425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90e449bd99b8) 00000020:00000080:0.0:1788846159.640330:0:19425:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788846159.640414:0:19425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90e344565000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788846159.640418:0:19425:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90e344565000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788846159.640421:0:19425:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90e344565000 3 00010000:00080000:0.0:1788846159.640613:0:19425:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90e34366d000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.120@tcp at head 00010000:00010000:0.0:1788846159.643744:0:19425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788846159.643955:0:19425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788846159.644003:0:19425:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788846159.644307:0:19425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x21b4d56138272d83 00000100:00080000:0.0:1788846159.644319:0:19425:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788846159.644324:0:19425:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90e34366d000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:0.0:1788846159.644358:0:19425:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e47d3b1180 x1875740702465152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788846159.644387:0:19425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788846159.644415:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846159.644419:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788846159.644422:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788846159.644425:0:16008:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788846159.644866:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702465152:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788846159.644947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.645004:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702465152 00000100:00100000:2.0:1788846159.645011:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702465152 00000100:00100000:2.0:1788846159.645040:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846159.645047:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3639:x1875740702465152:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788846159.645194:0:17088:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:2.0:1788846159.645224:0:17088:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x21b4d56138272d8a 00000004:00100000:2.0:1788846159.645238:0:17088:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788846159.645268:0:17088:0:(import.c:65:import_set_state_nolock()) ffff90e342706800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846159.645317:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1875740702465152:12345-0@lo:38:llog_process_th.0 Request processed in 268us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.645324:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788846159.645361:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b1180 x1875740702465152/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788846169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846159.645371:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846159.645379:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788846159.645386:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788846159.645390:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788846159.645393:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e34366d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788846159.645398:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3639:1875740702465152:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788846159.645890:0:19425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788846159.645943:0:19411:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788846159.645971:0:19411:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788846159.645984:0:19411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.646005:0:19411:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e46d42dc00/0x21b4d56138272d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d60 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788846159.646047:0:19411:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788846159.646049:0:19411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788846159.646050:0:19411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846159.646051:0:19411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846159.646052:0:19411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846159.646053:0:19411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846159.646054:0:19411:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846159.646056:0:19411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846159.646069:0:19411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788846159.646073:0:19411:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788846159.646075:0:19411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788846159.646077:0:19411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788846159.646078:0:19411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788846159.646079:0:19411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788846159.646080:0:19411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788846159.646081:0:19411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788846159.646082:0:19411:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788846159.646083:0:19411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788846159.646084:0:19411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788846159.646112:0:19411:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788846159.646126:0:19411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702465280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788846159.646168:0:19411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.646194:0:19411:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d1879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846159.646946:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702465280 00000100:00100000:0.0:1788846159.646955:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702465280 00000100:00100000:0.0:1788846159.646997:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788846159.647005:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702465280:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788846159.647168:0:17080:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788846159.647183:0:17080:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788846159.650981:0:17080:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788846159.650999:0:17080:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788846159.651869:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:19411:x1875740702465280:12345-0@lo:253:mount.lustre.0 Request processed in 4858us (5693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846159.651896:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788846159.651966:0:19411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6db0807f-6150-4b75-b37b-0ed71f62ed94:19411:1875740702465280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788846159.651984:0:19411:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788846159.651987:0:19411:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788846159.651988:0:19411:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788846159.651990:0:19411:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788846159.651991:0:19411:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788846159.651992:0:19411:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788846159.651993:0:19411:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788846159.651995:0:19411:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788846159.651996:0:19411:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788846159.651998:0:19411:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788846159.652012:0:19411:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788846159.652165:0:17104:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788846159.652170:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788846159.652190:0:17104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.652206:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272cfe expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.652214:0:17104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272d0c expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.652229:0:17104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.652263:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272d0c expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.652277:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272d0c expref: 23 pid: 17080 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846159.652290:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702465408:0@lo:104: 00000100:00100000:1.0:1788846159.652328:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846159.652368:0:17104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272cfe expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.652376:0:17104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272cfe expref: 23 pid: 17082 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846159.652385:0:17104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702465536:0@lo:104: 00000100:00100000:1.0:1788846159.652405:0:17104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.652421:0:17104:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e475d63d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788846159.652438:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702465408 00000100:00100000:1.0:1788846159.652443:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702465408 00000100:00100000:1.0:1788846159.652474:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702465536 00000100:00100000:1.0:1788846159.652477:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702465536 00000100:00100000:1.0:1788846159.652492:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846159.652499:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:17104:x1875740702465408:12345-0@lo:104: 00010000:00010000:1.0:1788846159.652510:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.655362:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788846159.655376:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:17104:x1875740702465408:12345-0@lo:104: Request processed in 2874us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.655387:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788846159.655415:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788846159.655424:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:17104:x1875740702465536:12345-0@lo:104: 00010000:00010000:1.0:1788846159.655439:0:17072:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.655501:0:17072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788846159.655507:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:17104:x1875740702465536:12345-0@lo:104: Request processed in 85us (3101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.655512:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788846159.655549:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846159.655555:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.655562:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ce00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:1.0:1788846159.655566:0:17844:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.655575:0:17844:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.656702:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846159.656710:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.656720:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:2.0:1788846159.656724:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788846159.656831:0:17844:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846159.656839:0:17844:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788846159.656889:0:17844:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.656897:0:17844:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788846159.656918:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.656926:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42ce00/0x21b4d56138272d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d13 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.656942:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846159.656944:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846159.656945:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846159.656964:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702465664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846159.657011:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788846159.657099:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788846159.657107:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846159.657112:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788846159.657127:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657133:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788846159.657146:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657153:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e441357600/0x21b4d56138272cfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d05 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657168:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846159.657170:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846159.657172:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846159.657185:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702465664 00000100:00100000:2.0:1788846159.657191:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702465664 00010000:00010000:2.0:1788846159.657218:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272d0c expref: 24 pid: 17080 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846159.657241:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846159.657248:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702465664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846159.657259:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846159.657263:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272d0c expref: 24 pid: 17080 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657279:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272d0c expref: 24 pid: 17080 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657294:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846159.657324:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702465664:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.657330:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846159.657366:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702465792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846159.657391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.657421:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702465792 00000100:00100000:2.0:1788846159.657425:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702465792 00010000:00010000:2.0:1788846159.657439:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272cfe expref: 24 pid: 17082 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846159.657456:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846159.657462:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3641:x1875740702465792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788846159.657469:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846159.657473:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272cfe expref: 24 pid: 17082 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657481:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272cfe expref: 24 pid: 17082 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657494:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657502:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788846159.657545:0:17073:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005375077s 00010000:00010000:2.0:1788846159.657549:0:17073:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657556:0:17073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657561:0:17073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657567:0:17073:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657571:0:17073:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846159.657574:0:17073:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.657581:0:17073:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.659221:0:17073:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846159.659237:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788846159.659602:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475065600/0x21b4d56138272d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272d0c expref: 24 pid: 17080 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846159.659616:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702465408:0@lo:104: 00010000:00010000:1.0:1788846159.659628:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272cfe expref: 23 pid: 17082 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846159.659638:0:17104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17104:1875740702465536:0@lo:104: 00010000:00010000:1.0:1788846159.659657:0:17104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.659666:0:17104:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.659672:0:17104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846159.659691:0:17104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272d91 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846159.659774:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:3641:x1875740702465792:12345-0@lo:103:ldlm_bl.0 Request processed in 2310us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.659783:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846159.659835:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702465664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846159.664924:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702465792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846159.676340:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846159.676377:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702465920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846159.676460:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846159.676508:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702465920 00000100:00100000:2.0:1788846159.676515:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702465920 00000100:00100000:2.0:1788846159.676577:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846159.676604:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702465920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846159.676637:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788846159.676681:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702465920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846159.676688:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846159.676746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702465920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846159.677300:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846159.677311:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702466048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846159.677347:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846159.677370:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702466048 00000100:00100000:1.0:1788846159.677375:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702466048 00000100:00100000:1.0:1788846159.677402:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788846159.677409:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702466048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846159.677429:0:17093:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846159.677557:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702466048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846159.677563:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788846159.677596:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702466048:0@lo:41:osp-pre-1-0.0 00000001:00000004:0.0:1788846159.678177:0:19411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788846159.683342:0:19411:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788846159.683352:0:19411:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788846159.683391:0:19411:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788846159.683498:0:19411:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788846159.683703:0:19411:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788846159.683725:0:19411:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788846159.684708:0:19411:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788846159.685136:0:19411:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788846160.582181:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846160.635480:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788846160.698183:0:17086:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788846160.698195:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e475188800 from 10 10000000:01000000:3.0:1788846160.698202:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788846160.698272:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.698285:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.698299:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846160.698335:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702466176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788846160.698459:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846160.698554:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846160.698735:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846140/real 1788846140] req@ffff90e47f4ec000 x1875740702453760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846160 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.698761:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e47f4ec000 x1875740702453760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846160 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.698772:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788846140/real 1788846140] req@ffff90e47f4ec380 x1875740702453888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846160 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.698784:0:3639:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90e47f4ec380 x1875740702453888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788846160 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788846160.698806:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846160.698829:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788846160.698833:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702453760:0@lo:8:kworker.0 00000100:00080000:2.0:1788846160.698839:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788846160.698853:0:3639:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788846160.698857:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702453888:0@lo:8:kworker.0 00000100:00100000:0.0:1788846160.699212:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702466176 00000100:00100000:0.0:1788846160.699225:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702466176 00000100:00100000:0.0:1788846160.699297:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788846160.699309:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:17086:x1875740702466176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846160.699327:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846160.699355:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441357c00/0x21b4d56138272d9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272d98 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.699388:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441357c00/0x21b4d56138272d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272d98 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.699399:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441357c00/0x21b4d56138272d9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272d98 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.699410:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357c00, rc 0) 00000100:00100000:0.0:1788846160.699477:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702466176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846160.699485:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788846160.700324:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702466176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846160.700351:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.700363:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846160.700448:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702466304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788846160.700510:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846160.700590:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846160.701161:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702466304 00000100:00100000:0.0:1788846160.701171:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702466304 00000100:00080000:2.0:1788846160.701328:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846160.701334:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788846160.701338:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846160.701345:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1788846160.701351:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788846160.701358:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90e44314f800 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846160.701385:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e343a38380 x1875740702466560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846160.701402:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846160.701406:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788846160.701407:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846160.701411:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:2.0:1788846160.701413:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788846160.701417:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90e47f491000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846160.701431:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e344438a80 x1875740702466688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788846160.701473:0:16008:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788846160.701477:0:16008:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788846160.701478:0:16008:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788846160.701482:0:16008:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1788846160.701485:0:16008:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788846160.701488:0:16008:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90e446110000 using connection 192.168.203.120@tcp/0@lo 00000100:00100000:2.0:1788846160.701515:0:16008:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90e34443aa00 x1875740702467200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788846160.701625:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702466432:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.701700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.701740:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702467328:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.701768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.701786:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702467840:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.701805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.701836:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788846160.701842:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702466816:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.701865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.701881:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702467456:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.701902:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.701929:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702467072:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.701956:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.701977:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702467712:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.701998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.702009:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788846160.702014:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702466944:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702035:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.702066:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702467584:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702099:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.702124:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702466432 00000100:00100000:2.0:1788846160.702130:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702466432 00000100:00100000:2.0:1788846160.702166:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702466944 00000100:00100000:2.0:1788846160.702177:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702466944 00000100:00100000:2.0:1788846160.702197:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788846160.702205:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702466432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702264:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702466432:12345-0@lo:400:kworker.0 Request processed in 59us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.702272:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788846160.702289:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788846160.702295:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702466944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702324:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702466944:12345-0@lo:400:kworker.0 Request processed in 29us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.702330:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788846160.702348:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702467328 00000100:00100000:2.0:1788846160.702351:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702467328 00000100:00100000:2.0:1788846160.702370:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702467840 00000100:00100000:2.0:1788846160.702373:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702467840 00000100:00100000:2.0:1788846160.702399:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702466816 00000100:00100000:2.0:1788846160.702402:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702466816 00000100:00100000:2.0:1788846160.702414:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702467456 00000100:00100000:2.0:1788846160.702416:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702467456 00000100:00100000:2.0:1788846160.702427:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702467712 00000100:00100000:2.0:1788846160.702429:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702467712 00000100:00100000:2.0:1788846160.702442:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702467584 00000100:00100000:2.0:1788846160.702444:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702467584 00000100:00100000:2.0:1788846160.702457:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788846160.702463:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702467328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702494:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875740702467328:12345-0@lo:400:kworker.0 Request processed in 31us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.702500:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788846160.702513:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846160.702566:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702467840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702596:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875740702467840:12345-0@lo:400:kworker.0 Request processed in 32us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.702602:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846160.702614:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846160.702619:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702466816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702644:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702466816:12345-0@lo:400:kworker.0 Request processed in 26us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.702650:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846160.702661:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846160.702669:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702467456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702696:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702467456:12345-0@lo:400:kworker.0 Request processed in 30us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.702703:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788846160.702718:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788846160.702723:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702467072 00000100:00100000:2.0:1788846160.702726:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702467712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846160.702730:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702467072 00000100:00100000:2.0:1788846160.702760:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702467712:12345-0@lo:400:kworker.0 Request processed in 35us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.702767:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846160.702778:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788846160.702784:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702467584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.702810:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875740702467584:12345-0@lo:400:kworker.0 Request processed in 26us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.702816:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788846160.702855:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788846160.702860:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788846160.702866:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702467072:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788846160.702873:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846160.702890:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702466560:0@lo:8:kworker.0 00000100:00100000:3.0:1788846160.702916:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702467072:12345-0@lo:400:kworker.0 Request processed in 52us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846160.702924:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788846160.702936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.702971:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702466688:0@lo:8:kworker.0 00000100:00100000:2.0:1788846160.703012:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.703044:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702467200:0@lo:8:kworker.0 00000100:00100000:2.0:1788846160.703065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.703111:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702466560 00000100:00100000:2.0:1788846160.703115:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702466560 00000100:00100000:2.0:1788846160.703127:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702466688 00000100:00100000:2.0:1788846160.703130:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702466688 00000100:00100000:2.0:1788846160.703139:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702467200 00000100:00100000:2.0:1788846160.703141:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702467200 00000100:00100000:2.0:1788846160.703150:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846160.703154:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702466560:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788846160.703184:0:18595:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:2.0:1788846160.703219:0:18595:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138272da6 00000100:00100000:3.0:1788846160.703221:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788846160.703229:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3639:x1875740702466688:12345-0@lo:8:kworker.0 00002000:00100000:2.0:1788846160.703237:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90e342707000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788846160.703243:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788846160.703247:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1788846160.703252:0:18597:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1788846160.703278:0:18597:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x21b4d56138272dad 00002000:00100000:3.0:1788846160.703288:0:18597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90e343638800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788846160.703292:0:18597:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788846160.703294:0:18597:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788846160.703346:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788846160.703378:0:18595:0:(import.c:65:import_set_state_nolock()) ffff90e342705000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846160.703426:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702466560:12345-0@lo:8:kworker.0 Request processed in 269us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.703434:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788846160.703451:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846160.703456:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3639:x1875740702467200:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788846160.703482:0:18595:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:2.0:1788846160.703503:0:18595:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x21b4d56138272db4 00002000:00100000:2.0:1788846160.703510:0:18595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90e342701000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788846160.703514:0:18595:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788846160.703515:0:18595:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788846160.703566:0:18595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788846160.703579:0:18595:0:(import.c:65:import_set_state_nolock()) ffff90e342703000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846160.703607:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1875740702467200:12345-0@lo:8:kworker.0 Request processed in 150us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.703613:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788846160.703660:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702466944:0@lo:400:kworker.0 00010000:00080000:2.0:1788846160.703678:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344438700 x1875740702467584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703690:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3643:1875740702467584:0@lo:400:kworker.0 00010000:00080000:2.0:1788846160.703703:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e34443bb80 x1875740702467072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703711:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702467072:0@lo:400:kworker.0 00010000:00080000:2.0:1788846160.703722:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e34443a300 x1875740702467712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703730:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702467712:0@lo:400:kworker.0 00010000:00080000:2.0:1788846160.703778:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344438380 x1875740702466816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703787:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702466816:0@lo:400:kworker.0 00010000:00080000:2.0:1788846160.703809:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344439f80 x1875740702467456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703817:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702467456:0@lo:400:kworker.0 00000100:00100000:2.0:1788846160.703830:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702466432:0@lo:400:kworker.0 00010000:00080000:2.0:1788846160.703842:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e34443b100 x1875740702467328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703850:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875740702467328:0@lo:400:kworker.0 00010000:00080000:2.0:1788846160.703860:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344439c00 x1875740702467840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703868:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3640:1875740702467840:0@lo:400:kworker.0 00010000:00080000:2.0:1788846160.703898:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343a38380 x1875740702466560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703907:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846160.703915:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788846160.703924:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788846160.703930:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788846160.703933:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e44314f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788846160.703949:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788846160.703955:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702466560:0@lo:8:kworker.0 00010000:00080000:2.0:1788846160.703966:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e34443aa00 x1875740702467200/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.703973:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846160.703977:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788846160.703987:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788846160.703991:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788846160.703993:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e446110000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788846160.704008:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788846160.704011:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3639:1875740702467200:0@lo:8:kworker.0 00000004:00080000:2.0:1788846160.704068:0:17113:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788846160.704102:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17113:1875740702468096:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788846160.704141:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.704158:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187180 going to sleep for 11 seconds 00000004:00080000:2.0:1788846160.704174:0:17112:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00002000:00080000:3.0:1788846160.704194:0:18597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788846160.704216:0:18597:0:(import.c:65:import_set_state_nolock()) ffff90e34363b000 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1788846160.704261:0:17112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 544741739818ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788846160.704265:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1875740702466688:12345-0@lo:8:kworker.0 Request processed in 1034us (1251us total) trans 0 rc 0/0 00080000:00080000:2.0:1788846160.704271:0:17112:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788846160.704276:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788846160.704293:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702468096 00000100:00100000:3.0:1788846160.704297:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702468096 00000004:00080000:2.0:1788846160.704311:0:17832:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788846160.704335:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788846160.704343:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17113:x1875740702468096:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788846160.704364:0:17832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 544741842668ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788846160.704370:0:17832:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788846160.704589:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788846160.704599:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702467968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846160.704630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788846160.704672:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344438a80 x1875740702466688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788846185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.704681:0:3639:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788846160.704687:0:3639:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788846160.704692:0:3639:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788846160.704696:0:3639:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788846160.704698:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90e47f491000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788846160.704721:0:3639:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788846160.704726:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3639:1875740702466688:0@lo:8:kworker.0 00000004:00080000:3.0:1788846160.704920:0:17833:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788846160.704943:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1875740702468352:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788846160.704975:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846160.705130:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3427f1540 going to sleep for 11 seconds 00000004:00080000:0.0:1788846160.705150:0:17115:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788846160.705165:0:17115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17115:1875740702468608:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788846160.705195:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846160.705208:0:17115:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d6a8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788846160.705240:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788846160.705252:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702466304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788846160.705273:0:17083:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788846160.705294:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788846160.705297:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788846160.706177:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702468224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846160.706227:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846160.706298:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846160.706304:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702468480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846160.706327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846160.706361:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702468352 00000100:00100000:1.0:1788846160.706369:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702468352 00000100:00100000:1.0:1788846160.706405:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702468608 00000100:00100000:1.0:1788846160.706408:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702468608 00000100:00100000:1.0:1788846160.706425:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788846160.706433:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17833:x1875740702468352:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788846160.706941:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702466304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1689us (6427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846160.706952:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788846160.707637:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702467968 00000100:00100000:3.0:1788846160.707648:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702467968 00000100:00100000:3.0:1788846160.707686:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702468224 00000100:00100000:3.0:1788846160.707690:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702468224 00000100:00100000:3.0:1788846160.707703:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702468480 00000100:00100000:3.0:1788846160.707706:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702468480 00000100:00100000:3.0:1788846160.707723:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846160.707732:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875740702467968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788846160.707853:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788846160.707935:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1875740702467968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (3303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846160.707942:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846160.707957:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846160.707965:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875740702468224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788846160.707976:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788846160.708705:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1875740702468224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 738us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846160.708713:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846160.708732:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846160.708741:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875740702468480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846160.708753:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00010000:00080000:0.0:1788846160.708973:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3eca80 x1875740702467968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846160.709009:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702467968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846160.709073:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875740702468480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 333us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846160.709090:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788846160.710044:0:17114:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788846160.710173:0:17114:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 544747651711ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788846160.710182:0:17114:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788846160.712379:0:17068:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788846160.712955:0:18597:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788846160.712970:0:18597:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00000100:00080000:2.0:1788846160.713977:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788846160.713986:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:02000040:3.0:1788846160.714307:0:18597:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00010000:00080000:1.0:1788846160.717112:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b0a80 x1875740702468480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846160.717182:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702468480:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788846160.717204:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f4ef100 x1875740702468224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788846176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846160.717220:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702468224:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1788846160.719212:0:18598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788846160.719226:0:18598:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788846160.719452:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17833:x1875740702468352:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13013us (14470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846160.719466:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846160.719517:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846160.719556:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17115:x1875740702468608:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1788846160.721048:0:17833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f4eca80 x1875740702468352/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788846176 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.721071:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1875740702468352:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788846160.721099:0:17833:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788846160.721163:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1875740702468736:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788846160.721236:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.721404:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d1879c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788846160.721460:0:17821:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788846160.721802:0:19094:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788846160.721813:0:19094:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:2.0:1788846160.724500:0:17068:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788846160.724690:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702468736 00000100:00100000:2.0:1788846160.724703:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702468736 00000100:00100000:2.0:1788846160.724842:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788846160.724853:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17833:x1875740702468736:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788846160.724889:0:19458:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788846160.724982:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17833:x1875740702468736:12345-0@lo:5:osp-pre-1-1.0 Request processed in 130us (3745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846160.724989:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788846160.725038:0:17833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3edf80 x1875740702468736/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788846176 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846160.725053:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1875740702468736:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788846160.725067:0:17833:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788846160.725125:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1875740702468864:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788846160.725160:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.725188:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d1879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846160.725199:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702468864 00000100:00100000:2.0:1788846160.725202:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702468864 00000100:00100000:2.0:1788846160.725220:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788846160.725226:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17833:x1875740702468864:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788846160.725250:0:19094:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:2.0:1788846160.727857:0:18598:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788846160.727878:0:18598:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788846160.727887:0:18598:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:0.0:1788846160.753433:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702466304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788846160.753595:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788846160.753618:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.753632:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e475065800/0x21b4d56138272d98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272d9f expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788846160.753645:0:17086:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788846160.753648:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90e344550800 from 10 10000000:01000000:0.0:1788846160.753651:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788846160.753694:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.753715:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.753727:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846160.753750:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702468992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788846160.753822:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846160.753882:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d6a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788846160.756302:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702468992 00000100:00100000:1.0:1788846160.756324:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702468992 00000100:00100000:1.0:1788846160.756408:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788846160.756419:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702468992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846160.756439:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846160.756461:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272dc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272dbb expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.756498:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272dbb expref: 24 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.756511:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e3a00/0x21b4d56138272dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272dbb expref: 24 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.756541:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3a00, rc 0) 00000100:00100000:1.0:1788846160.756641:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:17086:x1875740702468992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (2818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846160.756649:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788846160.756713:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702468992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846160.756733:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.756762:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846160.756836:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702469120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788846160.756876:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846160.756897:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3437bb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788846160.756912:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702469120 00000100:00100000:1.0:1788846160.756915:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702469120 00000100:00100000:1.0:1788846160.756940:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788846160.756946:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:17086:x1875740702469120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788846160.756959:0:17080:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788846160.756978:0:17080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788846160.756981:0:17080:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788846160.757045:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:17086:x1875740702469120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846160.757052:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788846160.757074:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702469120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788846160.757153:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788846160.757161:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.757171:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441356400/0x21b4d56138272dbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272dc2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846160.759438:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.759457:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759479:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.759485:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.759494:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759517:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759547:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759571:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759597:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.759613:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.759620:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759629:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.759634:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759645:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759667:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759674:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bae22217/0x21b4d56138272dc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.759695:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.759697:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.759699:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.764358:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.764913:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.764936:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.764942:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.764950:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.764970:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.764982:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.764990:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.765034:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788846160.765291:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.765298:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765358:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846160.765488:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.765494:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.765499:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.765517:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.765544:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.765552:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.765566:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.765855:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765865:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.765870:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765881:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765904:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765912:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000db997e9/0x21b4d56138272dd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765936:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.765940:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765946:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.765949:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765956:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765982:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.765989:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272dd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.766005:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.766007:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.766010:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.766125:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846160.766334:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.766341:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.766353:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.766357:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.766362:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.766799:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.766810:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.766819:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.766850:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788846160.766908:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.766916:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.766926:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.766930:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.766934:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.766946:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.766955:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.766963:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.766990:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788846160.767004:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846160.767011:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767019:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.767023:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767031:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767045:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767053:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272dde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767071:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.767075:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767091:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.767094:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767113:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767124:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767131:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272de5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.767147:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.767148:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.767150:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.767348:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.767953:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.767963:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.767976:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.767980:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.767984:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846160.767986:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.767997:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.768001:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.768014:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.768017:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.768018:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.768027:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.768032:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.768057:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846160.768066:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.768070:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.768100:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.768104:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.768112:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.768123:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.768130:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272dec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.768144:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.768146:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.768148:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.768608:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.768619:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.768628:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.768645:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.768739:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.768746:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.768753:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.768757:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.768765:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.768777:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.768796:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272df3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.768812:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.768814:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.768816:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846160.769146:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.769152:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.769163:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.769167:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.769171:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.769181:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.769189:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.769207:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.769229:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.769270:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.769277:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.769286:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.769291:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.769299:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.769310:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.769329:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272dfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.769343:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.769345:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.769346:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846160.771215:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.771231:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.771251:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.771256:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.771263:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.771278:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.771291:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.771299:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.771324:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846160.772054:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.772066:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.772078:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.772094:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.772106:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.772153:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.772161:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.772190:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.772192:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.772194:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846160.772814:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.772826:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772840:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.772845:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.772851:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772865:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772875:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772883:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772906:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.772917:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.772922:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772931:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.772935:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772958:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772972:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772979:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272e08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.772997:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.772999:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.773001:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.775801:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.775821:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.775844:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.775850:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.775859:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.775875:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.775888:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.775896:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.775937:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.776237:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.776248:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.776259:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.776265:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.776274:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.776295:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.776316:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.776348:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.776350:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.776352:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.777449:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.777460:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.777484:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.777488:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.777494:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.777506:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.777517:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.777542:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.777566:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846160.778607:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846160.778620:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.778643:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846160.778648:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.778659:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.778680:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.778690:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000db997e9/0x21b4d56138272e16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.778712:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.778714:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.778716:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846160.780244:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846160.780260:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780287:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.780293:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846160.780300:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780449:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780462:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780479:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780502:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846160.780514:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846160.780929:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780941:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.780947:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780955:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780988:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.780995:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024066224/0x21b4d56138272e1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.781016:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.781018:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.781020:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.782115:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1788846160.782126:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.782130:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.782136:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.782154:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.782155:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.782160:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.782167:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.782171:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.782182:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.782192:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.782197:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.782211:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.782217:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.782222:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.782229:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.782258:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788846160.783937:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.783952:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.783970:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.783975:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.783981:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.783994:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.784007:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.784028:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.787402:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788846160.787588:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788846160.787724:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787745:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.787750:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787763:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787793:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787801:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce856b33/0x21b4d56138272e24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787839:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846160.787844:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787874:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ce00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.787877:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787884:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787897:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787904:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272e2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787923:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.787927:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787932:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.787935:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787943:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787952:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.787967:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.787969:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.787971:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.788712:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846160.789669:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.789682:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789703:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.789709:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.789717:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789734:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789746:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789755:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789798:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846160.789816:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846160.789823:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789832:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846160.789837:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789846:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789865:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789873:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272e39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.789898:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.789902:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.789905:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.791252:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788846160.791271:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042401a22/0x21b4d56138272e32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.792802:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.795727:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.795743:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.795766:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.795772:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.795779:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.795796:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.795809:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.795817:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.795859:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.795888:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.795898:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.795910:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.795916:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.795930:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.795952:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.795961:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a76c2c4/0x21b4d56138272e40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.795987:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.795989:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.795991:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.796111:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.796117:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796127:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.796131:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.796135:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796146:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796154:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796162:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796206:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.796223:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.796230:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.796246:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.796250:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.796259:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.796274:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.796282:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272e47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.796298:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.796301:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.796302:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.796362:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.796368:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796376:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.796385:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.796390:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796400:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796409:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.796417:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.798020:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788846160.798322:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.798333:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.798352:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.798358:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.798364:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.798378:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.798389:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.798404:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.798433:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788846160.802757:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846160.802774:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802793:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846160.802809:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802824:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802855:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802864:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a1c3bf0/0x21b4d56138272e4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802895:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846160.802900:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802909:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846160.802913:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802921:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802935:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802942:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272e55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.802968:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.802971:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.802974:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.803088:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846160.804754:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.804772:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.804791:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.804797:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.804805:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.804821:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.804834:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.804842:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.804872:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.805119:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.805128:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.805139:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.805145:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.805166:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.805184:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.805191:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001757666a/0x21b4d56138272e5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.805213:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.805214:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.805216:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788846160.806755:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.806772:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.806793:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.806798:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.806805:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.806820:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.806832:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.806841:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.806901:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788846160.807733:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.807744:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.807767:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.807771:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788846160.807777:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.807790:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.807800:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.807808:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808598:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788846160.808610:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808705:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846160.808711:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808722:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808745:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808754:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f2bd3fb/0x21b4d56138272e63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.808754:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846160.808785:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846160.808789:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808796:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846160.808800:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808810:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808820:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808838:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc767ef7/0x21b4d56138272e6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.808855:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.808857:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.808859:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846160.808986:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.808993:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.809004:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.809008:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.809013:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.809025:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.809033:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.809041:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.809415:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846160.812125:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846160.812145:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.812175:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.812183:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846160.812193:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.812215:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.812229:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.812238:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846160.812250:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.812266:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.812277:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.812281:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.812285:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.812298:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.812307:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.812889:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846160.812900:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.812912:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.812917:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.812928:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.812950:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.812975:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000869a972e/0x21b4d56138272e71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.812999:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.813002:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.813009:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.813013:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.813021:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.813033:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.813042:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.813043:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.813046:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.813288:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.813320:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788846160.813336:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788846160.813341:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.813349:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:2.0:1788846160.813353:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.813361:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.813379:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.813388:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cebc0db1/0x21b4d56138272e7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.813401:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.813403:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.813404:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846160.819372:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.819388:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.819411:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.819417:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.819425:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.819530:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.820226:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.820241:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.820250:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.820295:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788846160.820307:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.820317:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.820329:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.820341:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.820353:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788846160.820805:0:19412:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788846160.820841:0:19412:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788846160.820847:0:19412:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788846160.820897:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.820908:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df1a16a6/0x21b4d56138272e86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.820934:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.820936:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.820938:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846160.821057:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17833:x1875740702468864:12345-0@lo:5:osp-pre-1-1.0 Request processed in 95824us (95890us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788846160.821712:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788846160.821804:0:17833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788846160.821816:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17833:1875740702468864:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788846160.821839:0:17833:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788846160.821927:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17833:1875740702469248:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788846160.821994:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846160.822028:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450c7a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788846160.822060:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702469248 00000100:00100000:0.0:1788846160.822246:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702469248 00000100:00100000:0.0:1788846160.822312:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788846160.822324:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17833:x1875740702469248:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788846160.822396:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17833:x1875740702469248:12345-0@lo:900:osp-pre-1-1.0 Request processed in 75us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846160.822403:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788846160.822840:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788846160.822853:0:18597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024066224/0x21b4d56138272e78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.822897:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788846160.823347:0:17833:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47d3b3b80 x1875740702469248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788846176 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846160.823366:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17833:1875740702469248:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788846160.826170:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846160.826188:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.826211:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.826217:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846160.826225:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.826244:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.826257:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.826265:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.826281:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846160.826559:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.826570:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.826582:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.826589:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846160.826594:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788846160.826602:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.826626:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.826646:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1788846160.826646:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.826664:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.826678:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.826713:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe06a712/0x21b4d56138272e8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.826725:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.826740:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.826743:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.826747:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.826750:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.826756:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.826789:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846160.827562:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.827571:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.827583:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.827587:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.827597:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.827613:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.827620:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000255c21e7/0x21b4d56138272e94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.827650:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.827651:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.827653:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846160.828185:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846160.828201:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.828215:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.828219:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846160.828225:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.828237:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.828246:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.828253:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.828284:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846160.828655:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.828662:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.828671:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.828676:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.828685:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.828702:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.828711:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000625fdce0/0x21b4d56138272e9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.828733:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.828734:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.828736:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846160.829352:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846160.829362:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.829383:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.829388:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846160.829392:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.829402:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.829419:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.829427:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.829459:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846160.829897:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.829905:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.829914:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.829919:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.829941:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.829957:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.829964:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a08fccc2/0x21b4d56138272ea2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.829985:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.829986:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.829988:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846160.831971:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846160.831990:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832012:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.832018:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846160.832026:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832042:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832069:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832087:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832131:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788846160.832924:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846160.832933:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832946:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.832950:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846160.832955:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832965:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832972:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.832979:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833005:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788846160.833019:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846160.833026:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833034:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.833045:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833069:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833096:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833104:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ef99ebd/0x21b4d56138272ea9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833127:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846160.833130:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833135:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.833138:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833146:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833155:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833161:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000228826f9/0x21b4d56138272eb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.833181:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.833183:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.833185:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788846160.833978:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788846160.833987:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834000:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.834003:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846160.834008:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834019:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834028:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834036:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834070:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846160.834089:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846160.834094:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834116:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.834120:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834127:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834140:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834149:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000121b8594/0x21b4d56138272eb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.834167:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.834169:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.834171:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846160.835421:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.835434:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.835450:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.835453:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.835459:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.835825:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.835838:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.835860:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.835886:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846160.836142:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846160.836150:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.836158:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.836163:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.836171:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.836196:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.836203:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5e49e72/0x21b4d56138272ebe lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.836225:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.836227:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.836229:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846160.836867:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.836875:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.836887:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.836892:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.836897:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.836907:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.836915:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.836923:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.836946:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846160.837198:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846160.837205:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.837214:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.837218:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.837227:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.837240:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.837247:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048a04019/0x21b4d56138272ec5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.837274:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.837276:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.837278:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846160.838150:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.838161:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.838186:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.838191:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.838195:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.838206:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.838216:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.838224:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.838296:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788846160.839389:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.839458:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.839474:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.839478:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.839483:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.839497:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.839560:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.839568:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843025:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788846160.843045:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843760:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031000 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.843767:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843782:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843810:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843818:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8f54adb/0x21b4d56138272ecc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843856:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846160.843861:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843868:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.843890:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843899:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843914:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.843922:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.843924:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.843926:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.852648:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.856318:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846160.856333:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a793995/0x21b4d56138272ed3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.856380:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846160.856454:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.856738:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.856762:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.856782:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.856793:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.856813:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.856826:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.856836:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.856891:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788846160.857235:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.857244:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857260:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.857264:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.857271:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857285:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857296:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857318:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857338:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788846160.857349:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846160.857356:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857364:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.857368:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857377:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857395:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857402:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000869a972e/0x21b4d56138272eda lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857418:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846160.857421:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857439:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031800 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:3.0:1788846160.857443:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857452:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857464:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857473:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6172da7/0x21b4d56138272ee1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.857485:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.857487:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.857489:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.857904:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846160.858720:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.858731:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.858745:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.858749:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.858755:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.858766:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.858785:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.858793:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.858813:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846160.859477:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.859486:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.859499:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.859504:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.859516:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.859560:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.859584:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026f03923/0x21b4d56138272ee8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.859610:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.859612:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.859614:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788846160.859755:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.859763:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.859772:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.859776:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.859780:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.859790:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.859799:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.859808:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.859877:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788846160.861975:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.861990:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.862007:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.862024:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.862031:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.862047:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.862064:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.862072:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862550:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846160.862559:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862569:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.862574:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862584:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862605:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862614:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edd8c2a1/0x21b4d56138272eef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862635:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.862639:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862661:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.862664:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862672:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862683:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.862691:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.862692:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.862694:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.862859:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846160.862866:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd81ae5e/0x21b4d56138272ef6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846160.863620:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.863629:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.863650:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.863655:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.863661:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.863673:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.863683:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.863691:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.863759:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.863765:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.863773:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440030c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.863778:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.863787:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.863800:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.863820:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.863822:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.863825:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.863961:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846160.863967:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008005b0fb/0x21b4d56138272efd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846160.864495:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.864502:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.864511:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.864516:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.864573:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.864599:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.864609:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.864617:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.864664:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.864670:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.864678:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e440031c00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.864682:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.864691:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.864703:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.864716:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.864719:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.864724:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.864882:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846160.864888:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b61600d/0x21b4d56138272f04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846160.865421:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.865438:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.865449:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.865453:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.865458:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.865469:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.865489:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.865497:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.867946:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.867961:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.867975:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.867981:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.868010:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.868042:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.868209:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.868212:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.868218:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.868346:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846160.868354:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f2bd3fb/0x21b4d56138272f0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846160.868973:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.868980:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.868994:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.868998:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.869005:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.869029:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.869039:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.869071:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869318:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.869326:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869335:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357e00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.869342:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869352:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869374:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869384:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.869386:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.869387:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788846160.869643:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.869658:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.869675:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.869682:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.869689:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.869707:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.869718:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.869738:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.869774:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788846160.869840:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.869850:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869861:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.869866:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869875:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869890:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869899:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001757666a/0x21b4d56138272f19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.869920:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.869922:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.869924:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.870064:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846160.870070:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d899ddf4/0x21b4d56138272f12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846160.871032:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.871040:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.871061:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.871065:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.871071:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.871091:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.871102:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.871110:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.871436:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.871444:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.871452:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357a00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.871456:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.871477:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.871493:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.871502:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.871504:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.871506:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846160.871625:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846160.871630:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a1c3bf0/0x21b4d56138272f20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846160.871789:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.871803:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.871818:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.871823:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.871828:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.871842:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.871851:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.871860:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846160.872248:0:18598:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788846160.872257:0:18598:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.872268:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=544s v=(0 0) 00010000:00010000:3.0:1788846160.872272:0:18598:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846160.872277:0:18598:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.872289:0:18598:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.872299:0:18598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846160.872307:0:18598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.872421:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846160.872428:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.872437:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ce00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.872441:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.872449:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.872464:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.872474:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.872478:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.872496:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.872500:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.872507:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.873839:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.873876:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788846160.873888:0:18597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060856349/0x21b4d56138272f27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846160.875352:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.875366:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.875387:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.875392:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.875400:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.875495:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.875509:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.875517:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.875560:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788846160.876110:0:17077:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846160.876120:0:17077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.876133:0:17077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846160.876139:0:17077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.876151:0:17077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.876176:0:17077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.876199:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d56138272f35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846160.876213:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.876221:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.876227:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.876231:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1788846160.876231:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.876234:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788846160.876237:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.876250:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876261:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876268:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876275:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876296:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788846160.876884:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788846160.876892:0:18597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876904:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=544s v=(0 0) 00010000:00010000:2.0:1788846160.876907:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846160.876911:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876922:0:18597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876931:0:18597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876951:0:18597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846160.876971:0:18597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788846160.876994:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788846160.877018:0:18597:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:0.0:1788846160.877026:0:17844:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788846160.877035:0:17844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.877047:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788846160.877047:0:17844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d200 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.877056:0:17844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.877059:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.877117:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:0.0:1788846160.877122:0:17844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.877124:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.877151:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.877189:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.877198:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bf9206b/0x21b4d56138272f43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846160.877198:0:17844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846160.877236:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17113:x1875740702468096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 172883us (173084us total) trans 0 rc 0/0 00010000:00010000:0.0:1788846160.877240:0:17844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1a16a6/0x21b4d56138272f3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846160.877249:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846160.877250:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788846160.877254:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.877257:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846160.877275:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.877296:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.877302:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846160.877308:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846160.877345:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17113:1875740702468096:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788846160.877369:0:17113:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788846160.877513:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17113:1875740702469376:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788846160.877580:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846160.877615:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a8540 going to sleep for 11 seconds 00000100:00100000:2.0:1788846160.877638:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702469376 00000100:00100000:2.0:1788846160.877645:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702469376 00000100:00100000:2.0:1788846160.878267:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846160.878282:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17113:x1875740702469376:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788846160.878333:0:18597:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788846160.878744:0:18598:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788846160.878766:0:18598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ba1e50/0x21b4d56138272f2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18598 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788846160.878928:0:18598:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1788846160.879041:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17115:x1875740702468608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 159488us (173842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846160.879052:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788846160.879087:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846160.879124:0:17115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17115:1875740702468608:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788846160.879140:0:17115:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788846160.879496:0:17115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17115:1875740702469504:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788846160.879577:0:17115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846160.879602:0:17115:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e452efd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788846160.879619:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702469504 00000100:00100000:3.0:1788846160.879625:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702469504 00000100:00100000:3.0:1788846160.879668:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788846160.879677:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17115:x1875740702469504:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788846160.879710:0:19458:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788846160.889958:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17115:x1875740702469504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10275us (10374us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788846160.889972:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788846160.890060:0:17115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17115:1875740702469504:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788846160.890098:0:17115:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:0.0:1788846160.895066:0:18592:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788846160.895157:0:18592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788846160.895449:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17113:x1875740702469376:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17168us (17865us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788846160.895460:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788846160.895727:0:17113:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788846160.895737:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17113:1875740702469376:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788846160.895752:0:17113:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000020:00000004:3.0:1788846161.031329:0:19478:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788846161.031580:0:19478:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788846161.594682:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846162.627616:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788846163.641759:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846164.287135:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702469632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788846164.287215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846164.287291:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702469632 00000100:00100000:0.0:1788846164.287298:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702469632 00000100:00100000:0.0:1788846164.287358:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846164.287368:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702469632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788846164.287398:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788846164.287437:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702469632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846164.287444:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788846164.287496:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702469632:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788846164.288418:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788846164.665656:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846164.793749:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788846164.793770:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702469760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846164.793844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846164.794104:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702469760 00000100:00100000:1.0:1788846164.794112:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702469760 00000100:00100000:1.0:1788846164.794160:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788846164.794169:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702469760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846164.794200:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846164.794291:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702469760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846164.794298:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788846164.794814:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702469888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846164.794845:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846164.794890:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702469888 00000100:00100000:2.0:1788846164.794894:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702469888 00000100:00100000:2.0:1788846164.794919:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788846164.794924:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702469888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846164.794941:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788846164.794971:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702469888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846164.794977:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788846164.795009:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702469888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846164.805151:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702469760:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788846165.689807:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846165.817698:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846165.817720:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702470016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846165.817787:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818318:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702470144:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818357:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818391:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702470656:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818416:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818431:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702471168:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818474:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788846165.818479:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702470272:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818512:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702470784:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818552:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818570:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702471296:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818605:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818633:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702470400:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818654:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818671:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702470912:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818705:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702471424:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818726:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818741:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788846165.818745:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702470528:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818764:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818777:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702471040:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818798:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.818960:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702471552:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.818986:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.819009:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702470784 00000100:00100000:3.0:1788846165.819016:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702470784 00000100:00100000:3.0:1788846165.819064:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702470400 00000100:00100000:3.0:1788846165.819068:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702470400 00000100:00100000:3.0:1788846165.819090:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702470912 00000100:00100000:3.0:1788846165.819092:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702470912 00000100:00100000:3.0:1788846165.819108:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846165.819116:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702470784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.819162:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702470784:12345-0@lo:400:kworker.0 Request processed in 46us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846165.819168:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788846165.819182:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846165.819189:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702470400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.819219:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702470400:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846165.819225:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788846165.819237:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788846165.819243:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702470912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.819268:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702470912:12345-0@lo:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846165.819273:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788846165.819291:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788846165.819320:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702470784:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.819350:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702470400:0@lo:400:kworker.0 00000100:00100000:3.0:1788846165.819360:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702470912:0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.819461:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702470656 00000100:00100000:2.0:1788846165.819465:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702470656 00000100:00100000:2.0:1788846165.819498:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702470272 00000100:00100000:2.0:1788846165.819502:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702470272 00000100:00100000:2.0:1788846165.819517:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788846165.819544:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702470656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.819586:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702470656:12345-0@lo:400:kworker.0 Request processed in 43us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.819592:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788846165.819605:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788846165.819610:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702470272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.819638:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702470272:12345-0@lo:400:kworker.0 Request processed in 27us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.819643:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788846165.819660:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702471168 00000100:00100000:2.0:1788846165.819670:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702471168 00000100:00100000:2.0:1788846165.819696:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702471296 00000100:00100000:2.0:1788846165.819699:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702471296 00000100:00100000:2.0:1788846165.819712:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702471424 00000100:00100000:2.0:1788846165.819714:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702471424 00000100:00100000:2.0:1788846165.819725:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702470528 00000100:00100000:2.0:1788846165.819728:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702470528 00000100:00100000:2.0:1788846165.819737:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702471040 00000100:00100000:2.0:1788846165.819739:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702471040 00000100:00100000:2.0:1788846165.819748:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702471552 00000100:00100000:2.0:1788846165.819750:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702471552 00000100:00100000:2.0:1788846165.819763:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788846165.819768:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702471168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.819927:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702471168:12345-0@lo:400:kworker.0 Request processed in 32us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.819935:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788846165.819949:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788846165.819956:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702471296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.819986:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702471296:12345-0@lo:400:kworker.0 Request processed in 31us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.819992:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788846165.820003:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788846165.820009:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702471424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.820040:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702471424:12345-0@lo:400:kworker.0 Request processed in 32us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.820058:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788846165.820069:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788846165.820075:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702470528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.820109:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702470528:12345-0@lo:400:kworker.0 Request processed in 35us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.820116:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788846165.820126:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846165.820131:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702471040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.820151:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702471040:12345-0@lo:400:kworker.0 Request processed in 20us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.820156:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788846165.820164:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788846165.820170:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702471552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.820193:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702471552:12345-0@lo:400:kworker.0 Request processed in 25us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.820199:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788846165.820226:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788846165.820229:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846165.820250:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702470272:0@lo:400:kworker.0 00010000:00080000:2.0:1788846165.820262:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343650e00 x1875740702471296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846165.820271:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702471296:0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.820280:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702470656:0@lo:400:kworker.0 00010000:00080000:2.0:1788846165.820288:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343650000 x1875740702471168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846165.820296:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702471168:0@lo:400:kworker.0 00010000:00080000:2.0:1788846165.820332:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e47f4ec380 x1875740702470528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846165.820340:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702470528:0@lo:400:kworker.0 00010000:00080000:2.0:1788846165.820348:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343651f80 x1875740702471040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846165.820355:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702471040:0@lo:400:kworker.0 00010000:00080000:2.0:1788846165.820363:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343650a80 x1875740702471552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846165.820371:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702471552:0@lo:400:kworker.0 00010000:00080000:2.0:1788846165.820379:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343651500 x1875740702471424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846165.820387:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702471424:0@lo:400:kworker.0 00000100:00100000:0.0:1788846165.820461:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702470016 00000100:00100000:0.0:1788846165.820466:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702470016 00000100:00100000:0.0:1788846165.820505:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788846165.820513:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702470016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846165.820547:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788846165.820584:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702470016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (2797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846165.820591:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788846165.820628:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47d3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702470016:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788846165.820746:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846165.821038:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702470144 00000100:00100000:1.0:1788846165.821053:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702470144 00000100:00100000:1.0:1788846165.821086:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788846165.821093:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702470144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846165.821136:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702470144:12345-0@lo:400:kworker.0 Request processed in 44us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846165.821142:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788846165.821289:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702471680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788846165.821334:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846165.821363:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47f4ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702470144:0@lo:400:kworker.0 00000100:00100000:2.0:1788846165.821391:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702471680 00000100:00100000:2.0:1788846165.821395:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702471680 00000100:00100000:2.0:1788846165.821422:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846165.821428:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702471680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788846165.821444:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788846165.821472:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702471680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846165.821483:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788846165.821507:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702471680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846165.821657:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702471808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788846165.821684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846165.821712:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702471808 00000100:00100000:3.0:1788846165.821715:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702471808 00000100:00100000:3.0:1788846165.821738:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788846165.821744:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702471808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788846165.821755:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788846165.821783:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875740702471808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846165.821790:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788846165.821831:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702471808:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788846166.719925:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788846166.847424:0:19412:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:02000400:3.0:1788846166.926265:0:19768:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg320-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1788846167.099783:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788846167.738477:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788846167.868811:0:19820:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788846167.869057:0:19820:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788846168.743462:0:19870:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788846168.744337:0:19870:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788846168.763914:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846169.031622:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.031796:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683518976 00000100:00100000:1.0:1788846169.031820:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683518976 00000100:00100000:1.0:1788846169.031875:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:1.0:1788846169.031883:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1875740683518976:12345-192.168.203.20@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788846169.031911:0:17082:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a7b5cd26-e654-4a7c-b591-2ded2c0f1e54@192.168.203.20@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:1.0:1788846169.031941:0:17082:0:(genops.c:1385:class_connect()) connect: client a7b5cd26-e654-4a7c-b591-2ded2c0f1e54, cookie 0x21b4d56138272f4a 00000100:00080000:1.0:1788846169.032217:0:17082:0:(import.c:65:import_set_state_nolock()) ffff90e46e218800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846169.032327:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+5:2397:x1875740683518976:12345-192.168.203.20@tcp:250:mount.lustre.0 Request processed in 442us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.032335:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 114 00000100:00100000:1.0:1788846169.048300:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846169.048406:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683519104 00000100:00100000:2.0:1788846169.048416:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683519104 00000100:00100000:2.0:1788846169.048708:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:2.0:1788846169.048719:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+5:14877:x1875740683519104:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788846169.048735:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846169.048754:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aab600/0x21b4d56138272f51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548e8 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846169.048783:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aab600/0x21b4d56138272f51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548e8 expref: 6 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846169.048794:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aab600/0x21b4d56138272f51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548e8 expref: 6 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846169.048803:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aab600, rc 0) 00000100:00100000:2.0:1788846169.049158:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+6:14877:x1875740683519104:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 439us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.049166:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 115 00000100:00100000:2.0:1788846169.055288:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.055419:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683519232 00000100:00100000:1.0:1788846169.055430:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683519232 00000100:00100000:1.0:1788846169.055683:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:1.0:1788846169.055695:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+6:14877:x1875740683519232:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788846169.055848:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+6:14877:x1875740683519232:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 147us (560us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788846169.055857:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 116 00000100:00100000:3.0:1788846169.061212:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846169.061317:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683519360 00000100:00100000:2.0:1788846169.061327:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683519360 00000100:00100000:2.0:1788846169.061387:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:2.0:1788846169.061398:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+6:14877:x1875740683519360:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788846169.061429:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846169.061448:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aabe00/0x21b4d56138272f58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217548ef expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846169.061492:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aabe00/0x21b4d56138272f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548ef expref: 7 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846169.061503:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aabe00/0x21b4d56138272f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217548ef expref: 7 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846169.061512:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aabe00, rc 0) 00000100:00100000:2.0:1788846169.061622:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+7:14877:x1875740683519360:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 226us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.061630:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 117 00000100:00100000:3.0:1788846169.064732:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.065208:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683519488 00000100:00100000:1.0:1788846169.065218:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683519488 00000100:00100000:1.0:1788846169.065318:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:1.0:1788846169.065327:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+7:14877:x1875740683519488:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788846169.065497:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14877:x1875740683519488:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 171us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.065505:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 118 00000100:00100000:3.0:1788846169.075905:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.076328:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683519616 00000100:00100000:1.0:1788846169.076351:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683519616 00000100:00100000:1.0:1788846169.076414:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:1.0:1788846169.076425:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f50d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14877:x1875740683519616:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788846169.076626:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f50d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14877:x1875740683519616:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 203us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.076634:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 119 00000100:00100000:3.0:1788846169.084502:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.084682:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683519744 00000100:00100000:1.0:1788846169.084692:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683519744 00000100:00100000:1.0:1788846169.084751:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:1.0:1788846169.084761:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14896:x1875740683519744:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788846169.084947:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14896:x1875740683519744:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 188us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.084956:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 120 00000100:00100000:3.0:1788846169.110367:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846169.110498:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683519872 00000100:00100000:2.0:1788846169.110508:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683519872 00000100:00100000:2.0:1788846169.110587:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:2.0:1788846169.110597:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14896:x1875740683519872:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846169.110989:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14896:x1875740683519872:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 392us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.111005:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 121 00000100:00100000:0.0:1788846169.128362:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846169.128613:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683520000 00000100:00100000:2.0:1788846169.128623:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683520000 00000100:00100000:2.0:1788846169.128783:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:2.0:1788846169.128793:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14896:x1875740683520000:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846169.129127:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14896:x1875740683520000:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 334us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.129142:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 122 00000100:00100000:3.0:1788846169.143190:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.143510:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683520128 00000100:00100000:1.0:1788846169.143555:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683520128 00000100:00100000:1.0:1788846169.143719:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:1.0:1788846169.143732:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+8:14877:x1875740683520128:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788846169.143749:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846169.143769:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272f5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754920 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846169.143798:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754920 expref: 9 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846169.143809:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2200/0x21b4d56138272f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754920 expref: 9 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846169.143836:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2200, rc 0) 00000100:00100000:1.0:1788846169.144174:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+9:14877:x1875740683520128:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 444us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.144181:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 123 00000100:00100000:3.0:1788846169.148307:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846169.148401:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683520256 00000100:00100000:2.0:1788846169.148410:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683520256 00000100:00100000:2.0:1788846169.148462:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:2.0:1788846169.148472:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+9:14877:x1875740683520256:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788846169.148497:0:17080:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788846169.148547:0:17080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788846169.148551:0:17080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788846169.148554:0:17080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788846169.148557:0:17080:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788846169.148560:0:17080:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788846169.151231:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+9:14877:x1875740683520256:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 2753us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.151246:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 124 00000100:00100000:0.0:1788846169.154406:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.154514:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683520384 00000100:00100000:1.0:1788846169.154548:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683520384 00000100:00100000:1.0:1788846169.154602:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:1.0:1788846169.154612:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+9:14877:x1875740683520384:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788846169.154628:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846169.154656:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754927 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846169.154685:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 10 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846169.154697:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 10 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846169.154706:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2400, rc 0) 00000100:00100000:1.0:1788846169.154766:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14877:x1875740683520384:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 155us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.154772:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 125 00000100:00100000:3.0:1788846169.157114:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.157800:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683520512 00000100:00100000:1.0:1788846169.157824:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683520512 00000100:00100000:1.0:1788846169.158857:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:1.0:1788846169.158872:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14877:x1875740683520512:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788846169.159051:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14877:x1875740683520512:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 183us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.159060:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 126 00000100:00100000:2.0:1788846169.167054:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.167673:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683520640 00000100:00100000:3.0:1788846169.167686:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683520640 00000100:00100000:2.0:1788846169.167885:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:2.0:1788846169.168152:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14877:x1875740683520640:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788846169.168337:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14877:x1875740683520640:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 442us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.168345:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 127 00000100:00100000:0.0:1788846169.172706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.173043:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683520768 00000100:00100000:1.0:1788846169.173056:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683520768 00000100:00100000:1.0:1788846169.173174:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:1.0:1788846169.173184:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14901:x1875740683520768:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788846169.173355:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14901:x1875740683520768:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 171us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.173363:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 128 00000100:00100000:0.0:1788846169.180407:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.184566:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683520896 00000100:00100000:1.0:1788846169.184586:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683520896 00000100:00100000:1.0:1788846169.184750:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:1.0:1788846169.184763:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14901:x1875740683520896:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788846169.184934:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:14901:x1875740683520896:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 173us (4695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.184942:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 129 00000100:00100000:3.0:1788846169.195942:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.196041:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846169.196619:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683521024 00000100:00100000:2.0:1788846169.196638:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683521024 00000100:00100000:2.0:1788846169.196681:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683521280 00000100:00100000:2.0:1788846169.196684:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683521280 00000100:00100000:2.0:1788846169.196709:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788846169.196717:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875740683521024:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788846169.196745:0:17089:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 53da1059-0b4b-4ba8-a35c-806ac864d7eb@192.168.203.20@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1788846169.196792:0:17089:0:(genops.c:1385:class_connect()) connect: client 53da1059-0b4b-4ba8-a35c-806ac864d7eb, cookie 0x21b4d56138272f6d 00000004:00100000:2.0:1788846169.196827:0:17089:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788846169.197037:0:17089:0:(import.c:65:import_set_state_nolock()) ffff90e342705800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846169.197101:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2397:x1875740683521024:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 383us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.197109:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788846169.197126:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1788846169.197131:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875740683521280:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788846169.197146:0:17089:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 53da1059-0b4b-4ba8-a35c-806ac864d7eb@192.168.203.20@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1788846169.197177:0:17089:0:(genops.c:1385:class_connect()) connect: client 53da1059-0b4b-4ba8-a35c-806ac864d7eb, cookie 0x21b4d56138272f74 00000004:00100000:2.0:1788846169.197189:0:17089:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788846169.197308:0:17089:0:(import.c:65:import_set_state_nolock()) ffff90e34366a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788846169.197331:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2397:x1875740683521280:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 199us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.197338:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:0.0:1788846169.201392:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846169.201432:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.201503:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683521408 00000100:00100000:3.0:1788846169.201555:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683521408 00000100:00100000:3.0:1788846169.201618:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683521152 00000100:00100000:3.0:1788846169.201622:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683521152 00000100:00100000:3.0:1788846169.201661:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1788846169.201673:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:0:x1875740683521408:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788846169.201711:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788846169.201794:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:0:x1875740683521408:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 124us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846169.201802:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:3.0:1788846169.201818:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1788846169.201825:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:0:x1875740683521152:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788846169.201853:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788846169.201890:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:0:x1875740683521152:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 66us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846169.201896:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00080000:0.0:1788846169.202356:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788846169.202361:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846169.204967:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.205054:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683521536 00000100:00100000:3.0:1788846169.205064:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683521536 00000100:00100000:3.0:1788846169.205124:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1788846169.205134:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14877:x1875740683521536:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788846169.205162:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788846169.205282:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14877:x1875740683521536:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 148us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846169.205289:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1788846169.208636:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846169.208732:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683521664 00000100:00100000:1.0:1788846169.208742:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683521664 00000100:00100000:1.0:1788846169.208797:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:1.0:1788846169.208806:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14877:x1875740683521664:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788846169.208900:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14877:x1875740683521664:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 95us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.208917:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1788846169.216795:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.216906:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683521792 00000100:00100000:3.0:1788846169.216916:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683521792 00000100:00100000:0.0:1788846169.216924:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.216970:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683521920 00000100:00100000:3.0:1788846169.216974:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683521920 00000100:00100000:3.0:1788846169.217002:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1788846169.217010:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.217020:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875740683521792:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788846169.217066:0:18598:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 53da1059-0b4b-4ba8-a35c-806ac864d7eb@192.168.203.20@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1788846169.217114:0:18598:0:(genops.c:1385:class_connect()) connect: client 53da1059-0b4b-4ba8-a35c-806ac864d7eb, cookie 0x21b4d56138272f7b 00002000:00100000:3.0:1788846169.217127:0:18598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 53da1059-0b4b-4ba8-a35c-806ac864d7eb/ffff90e474532800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788846169.217186:0:18598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788846169.217260:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1788846169.217266:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875740683521920:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788846169.217284:0:18597:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 53da1059-0b4b-4ba8-a35c-806ac864d7eb@192.168.203.20@tcp t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1788846169.217309:0:18597:0:(genops.c:1385:class_connect()) connect: client 53da1059-0b4b-4ba8-a35c-806ac864d7eb, cookie 0x21b4d56138272f82 00002000:00100000:2.0:1788846169.217314:0:18597:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 53da1059-0b4b-4ba8-a35c-806ac864d7eb/ffff90e344594800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788846169.217324:0:18597:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788846169.217362:0:18598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788846169.217393:0:18598:0:(import.c:65:import_set_state_nolock()) ffff90e474530800 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1788846169.217431:0:18597:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788846169.217445:0:18597:0:(import.c:65:import_set_state_nolock()) ffff90e344597000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846169.217477:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2397:x1875740683521792:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 457us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.217478:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2397:x1875740683521920:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 212us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846169.217485:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:2.0:1788846169.217493:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1788846169.217508:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683522048 00000100:00100000:2.0:1788846169.217512:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683522048 00000100:00100000:2.0:1788846169.217576:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1788846169.217583:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14877:x1875740683522048:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788846169.217619:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14877:x1875740683522048:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 36us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.217625:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1788846169.227145:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.227285:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683522176 00000100:00100000:3.0:1788846169.227295:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683522176 00000100:00100000:3.0:1788846169.227355:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788846169.227367:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14877:x1875740683522176:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788846169.229039:0:17091:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1571us 00000004:00200000:2.0:1788846169.245539:0:17091:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788846169.245675:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14877:x1875740683522176:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 18305us (18534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.245690:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788846169.404622:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846169.404646:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702471936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846169.404715:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846169.407162:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702471936 00000100:00100000:2.0:1788846169.407177:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702471936 00000100:00100000:2.0:1788846169.407394:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788846169.407406:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702471936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788846169.407433:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788846169.407690:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702471936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 286us (2973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846169.407699:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788846169.407821:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846169.407885:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702471936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788846169.445057:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846169.445230:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683522304 00000100:00100000:3.0:1788846169.445240:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683522304 00000100:00100000:3.0:1788846169.445295:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1788846169.445305:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14924:x1875740683522304:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788846169.445324:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846169.445362:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754958 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846169.445423:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272f90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846169.445438:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846169.445451:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846169.445497:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788846169.445501:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846169.445564:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846169.445588:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754958 expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846169.445604:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754958 expref: 7 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846169.445612:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e45176fa00) 00010000:00010000:3.0:1788846169.445615:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846169.445618:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357600, rc 0) 00000100:00100000:3.0:1788846169.445689:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:14924:x1875740683522304:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 385us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846169.445696:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00010000:00010000:1.0:1788846169.785790:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846169.914007:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788846169.914039:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702472064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846169.914106:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846169.914535:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788846169.914546:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702472192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788846169.914577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846169.914674:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702472064 00000100:00100000:1.0:1788846169.914681:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702472064 00000100:00100000:1.0:1788846169.914730:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702472192 00000100:00100000:1.0:1788846169.914734:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702472192 00000100:00100000:1.0:1788846169.914752:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788846169.914761:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702472064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788846169.914786:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788846169.914834:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702472064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.914841:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788846169.914879:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788846169.914886:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702472192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846169.914897:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846169.914928:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702472192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846169.914934:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788846169.914980:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702472192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788846169.915009:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702472064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788846170.810036:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788846170.874279:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788846170.937699:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788846170.937716:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702472448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788846170.937727:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702472320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846170.937837:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702472576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846170.938637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846170.938702:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702472448 00000100:00100000:0.0:1788846170.938711:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702472448 00000100:00100000:0.0:1788846170.939002:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788846170.939029:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702472448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788846170.939053:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846170.939102:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702472448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.939109:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788846170.939131:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846170.939157:0:3642:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788846170.939180:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702472448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788846170.942140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846170.942264:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702472320 00000100:00100000:0.0:1788846170.942274:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702472320 00000100:00100000:0.0:1788846170.942496:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788846170.942506:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702472320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846170.942549:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788846170.942600:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702472320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.942607:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788846170.942680:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846170.942717:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702472320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846170.943024:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702472960:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.943062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846170.943084:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702473472:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.943120:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846170.943138:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702473984:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.943162:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846170.943183:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788846170.943188:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702473088:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.943210:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846170.943228:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702473600:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.943245:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846170.943273:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702472960 00000100:00100000:1.0:1788846170.943277:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702472960 00000100:00100000:3.0:1788846170.943491:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702472704:0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.943544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846170.943572:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702473216:0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.943597:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846170.943617:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702473728:0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.943636:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846170.943647:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788846170.943653:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702472832:0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.943674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846170.943692:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702473344:0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.943714:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846170.943729:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702473856:0@lo:400:kworker.0 00000100:00100000:0.0:1788846170.943896:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702473472 00000100:00100000:0.0:1788846170.943901:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702473472 00000100:00100000:0.0:1788846170.943922:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702473984 00000100:00100000:0.0:1788846170.943925:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702473984 00000100:00100000:0.0:1788846170.943943:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702473600 00000100:00100000:0.0:1788846170.943946:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702473600 00000100:00100000:0.0:1788846170.943957:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702473728 00000100:00100000:0.0:1788846170.943967:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702473728 00000100:00100000:0.0:1788846170.943987:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788846170.943995:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702472960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846170.944058:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702472960:12345-0@lo:400:kworker.0 Request processed in 64us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.944065:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788846170.944092:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788846170.944098:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702473472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846170.944123:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702473472:12345-0@lo:400:kworker.0 Request processed in 26us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.944129:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788846170.944141:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788846170.944146:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702473984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846170.944174:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702473984:12345-0@lo:400:kworker.0 Request processed in 29us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.944179:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788846170.944189:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788846170.944194:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702473600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846170.944220:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702473600:12345-0@lo:400:kworker.0 Request processed in 26us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.944224:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788846170.944234:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788846170.944240:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702473728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846170.944264:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702473728:12345-0@lo:400:kworker.0 Request processed in 25us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.944279:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788846170.944904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788846170.944945:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e8e00 x1875740702473728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788846170.944958:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702473728:0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.944989:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702473216 00000100:00100000:3.0:1788846170.944994:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702473216 00000100:00100000:3.0:1788846170.945039:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702473344 00000100:00100000:3.0:1788846170.945042:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702473344 00000100:00100000:3.0:1788846170.945067:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846170.945083:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702473216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.945122:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343650000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702473216:12345-0@lo:400:kworker.0 Request processed in 40us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846170.945127:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788846170.945140:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846170.945145:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702473344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.945170:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702473344:12345-0@lo:400:kworker.0 Request processed in 26us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846170.945175:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788846170.945198:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702473088 00000100:00100000:3.0:1788846170.945203:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702473088 00000100:00100000:3.0:1788846170.945225:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702472832 00000100:00100000:3.0:1788846170.945228:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702472832 00000100:00100000:3.0:1788846170.945241:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788846170.945246:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702473088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.945274:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702473088:12345-0@lo:400:kworker.0 Request processed in 28us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846170.945280:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788846170.945292:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788846170.945624:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702473856 00000100:00100000:1.0:1788846170.945629:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702473856 00000100:00100000:1.0:1788846170.945652:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788846170.945659:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702473856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.945694:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875740702473856:12345-0@lo:400:kworker.0 Request processed in 36us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846170.945700:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788846170.945951:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702472704 00000100:00100000:0.0:1788846170.945956:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702472704 00000100:00100000:0.0:1788846170.945987:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788846170.945994:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702472704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.946045:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702473088:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.946060:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702473600:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.946070:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702472960:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.946081:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702473472:0@lo:400:kworker.0 00010000:00080000:1.0:1788846170.946094:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e4437a4000 x1875740702473984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846170.946102:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788846170.946985:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846170.947770:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702472704:12345-0@lo:400:kworker.0 Request processed in 1773us (4222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.947779:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788846170.947825:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702472576 00000100:00100000:0.0:1788846170.947831:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702472576 00000100:00100000:0.0:1788846170.947865:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788846170.947872:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702472576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788846170.947890:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846170.947935:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702472576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846170.947941:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788846170.948030:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846170.948036:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846170.948039:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788846170.948080:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702473344:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.948099:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3640:1875740702473856:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.948108:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702472704:0@lo:400:kworker.0 00000100:00100000:1.0:1788846170.948118:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702473216:0@lo:400:kworker.0 00000100:00100000:2.0:1788846170.951614:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702472576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846170.954610:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846170.954712:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702472832:12345-0@lo:400:kworker.0 Request processed in 9413us (11036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846170.954721:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788846170.954922:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702472832:0@lo:400:kworker.0 00000100:00100000:1.0:1788846171.757619:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846171.757709:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683522432 00000100:00100000:0.0:1788846171.757720:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683522432 00000100:00100000:0.0:1788846171.757796:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1788846171.757807:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:14976:x1875740683522432:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:0.0:1788846171.757882:0:18618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788846171.757962:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:14976:x1875740683522432:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 158us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846171.757970:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00080000:1.0:1788846171.758320:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788846171.765161:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846171.766361:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683522560 00000100:00100000:3.0:1788846171.766373:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683522560 00000100:00100000:3.0:1788846171.766502:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1788846171.766513:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14976:x1875740683522560:12345-192.168.203.20@tcp:41:lfs.0 00000004:00000024:3.0:1788846171.766599:0:17088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788846171.766920:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14976:x1875740683522560:12345-192.168.203.20@tcp:41:lfs.0 Request processed in 407us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846171.766928:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00080000:1.0:1788846171.769131:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846171.772259:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846171.772337:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683522688 00000100:00100000:1.0:1788846171.772346:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683522688 00000100:00100000:1.0:1788846171.772414:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:1.0:1788846171.772424:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14976:x1875740683522688:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:1.0:1788846171.772464:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788846171.772563:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343badc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14976:x1875740683522688:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 139us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846171.772570:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00080000:3.0:1788846171.773560:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788846171.775749:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846171.776106:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683522816 00000100:00100000:0.0:1788846171.776130:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683522816 00000100:00100000:0.0:1788846171.776249:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:0.0:1788846171.776261:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14976:x1875740683522816:12345-192.168.203.20@tcp:13:lfs.0 00002000:00000024:0.0:1788846171.776295:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846171.776380:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:14976:x1875740683522816:12345-192.168.203.20@tcp:13:lfs.0 Request processed in 121us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846171.776387:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00080000:3.0:1788846171.785666:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788846171.833705:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846171.956304:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846171.956398:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683522944 00000100:00100000:2.0:1788846171.956408:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683522944 00000100:00100000:2.0:1788846171.956478:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:2.0:1788846171.956488:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+10:15008:x1875740683522944:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788846171.956504:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846171.956540:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaa400/0x21b4d56138272f97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc62175495f expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846171.956570:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaa400/0x21b4d56138272f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175495f expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846171.956581:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaa400/0x21b4d56138272f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc62175495f expref: 11 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846171.956590:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa400, rc 0) 00000100:00100000:2.0:1788846171.956651:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15008:x1875740683522944:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 165us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846171.956657:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 131 00000100:00100000:2.0:1788846171.967895:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846171.968043:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683523072 00000100:00100000:0.0:1788846171.968057:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683523072 00000100:00100000:0.0:1788846171.968126:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:0.0:1788846171.968137:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15008:x1875740683523072:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788846171.968333:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15008:x1875740683523072:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 197us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846171.968341:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 132 00000100:00100000:3.0:1788846171.979293:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846171.979495:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683523200 00000100:00100000:1.0:1788846171.979505:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683523200 00000100:00100000:1.0:1788846171.979586:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:1.0:1788846171.979596:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15008:x1875740683523200:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788846171.979760:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15008:x1875740683523200:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 164us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846171.979768:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 133 00000100:00100000:1.0:1788846171.984606:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846171.984736:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683523328 00000100:00100000:2.0:1788846171.984745:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683523328 00000100:00100000:2.0:1788846171.984798:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:2.0:1788846171.984808:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15015:x1875740683523328:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846171.984957:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15015:x1875740683523328:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 149us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846171.984980:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 134 00000100:00100000:2.0:1788846172.017304:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846172.017387:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683523456 00000100:00100000:0.0:1788846172.017397:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683523456 00000100:00100000:0.0:1788846172.017456:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:0.0:1788846172.017466:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15015:x1875740683523456:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788846172.017644:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15015:x1875740683523456:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 178us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846172.017652:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 135 00000100:00100000:3.0:1788846172.024116:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846172.026626:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683523584 00000100:00100000:1.0:1788846172.026645:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683523584 00000100:00100000:1.0:1788846172.026817:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:1.0:1788846172.026836:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f49ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15015:x1875740683523584:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788846172.027106:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f49ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15015:x1875740683523584:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 271us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846172.027116:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 136 00000100:00100000:1.0:1788846172.033338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846172.033462:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683523712 00000100:00100000:2.0:1788846172.033476:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683523712 00000100:00100000:2.0:1788846172.033587:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:2.0:1788846172.033600:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:15008:x1875740683523712:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788846172.033624:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846172.033649:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaae00/0x21b4d56138272f9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754990 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846172.033687:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaae00/0x21b4d56138272f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754990 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846172.033701:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaae00/0x21b4d56138272f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754990 expref: 12 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846172.033712:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaae00, rc 0) 00000100:00100000:2.0:1788846172.033834:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:15008:x1875740683523712:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 237us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846172.033851:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 137 00000100:00100000:2.0:1788846172.037672:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846172.037784:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683523840 00000100:00100000:1.0:1788846172.037799:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683523840 00000100:00100000:1.0:1788846172.037876:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:1.0:1788846172.037888:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:15008:x1875740683523840:12345-192.168.203.20@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788846172.037922:0:17083:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788846172.037955:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788846172.037960:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788846172.037963:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788846172.037966:0:17083:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788846172.037968:0:17083:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788846172.039770:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:15008:x1875740683523840:12345-192.168.203.20@tcp:256:mount.lustre.0 Request processed in 1870us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846172.039786:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 138 00000100:00100000:3.0:1788846172.043896:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846172.044773:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683523968 00000100:00100000:0.0:1788846172.044790:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683523968 00000100:00100000:0.0:1788846172.044914:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:0.0:1788846172.044926:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:15008:x1875740683523968:12345-192.168.203.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788846172.044965:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846172.045000:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754997 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846172.045049:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846172.045062:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846172.045074:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0d800, rc 0) 00000100:00100000:0.0:1788846172.045148:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15008:x1875740683523968:12345-192.168.203.20@tcp:101:mount.lustre.0 Request processed in 225us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846172.045156:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 139 00000100:00100000:2.0:1788846172.049058:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846172.049653:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683524096 00000100:00100000:1.0:1788846172.049691:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683524096 00000100:00100000:1.0:1788846172.049782:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:1.0:1788846172.049794:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15008:x1875740683524096:12345-192.168.203.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788846172.050041:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15008:x1875740683524096:12345-192.168.203.20@tcp:501:mount.lustre.0 Request processed in 249us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846172.050050:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 140 00000100:00100000:3.0:1788846172.053372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846172.053903:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683524224 00000100:00100000:0.0:1788846172.053918:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683524224 00000100:00100000:0.0:1788846172.054011:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:0.0:1788846172.054026:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15008:x1875740683524224:12345-192.168.203.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788846172.054228:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15008:x1875740683524224:12345-192.168.203.20@tcp:503:mount.lustre.0 Request processed in 205us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846172.054249:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 141 00000100:00100000:3.0:1788846172.061635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846172.061869:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683524352 00000100:00100000:2.0:1788846172.061883:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683524352 00000100:00100000:2.0:1788846172.061951:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:2.0:1788846172.061964:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15021:x1875740683524352:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788846172.062194:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15021:x1875740683524352:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 233us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846172.062204:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 142 00000100:00100000:2.0:1788846172.076734:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846172.076852:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683524480 00000100:00100000:1.0:1788846172.076865:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683524480 00000100:00100000:1.0:1788846172.076934:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:1.0:1788846172.076945:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15021:x1875740683524480:12345-192.168.203.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788846172.077207:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:15021:x1875740683524480:12345-192.168.203.20@tcp:502:llog_process_th.0 Request processed in 262us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846172.077216:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 143 00000100:00100000:3.0:1788846172.086361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846172.086406:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846172.086448:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846172.086561:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683524608 00000100:00100000:0.0:1788846172.086577:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683524608 00000100:00100000:0.0:1788846172.086628:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683524736 00000100:00100000:0.0:1788846172.086631:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683524736 00000100:00100000:0.0:1788846172.086671:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1788846172.086683:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:2398:x1875740683524736:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846172.086805:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:2398:x1875740683524736:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 123us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846172.086815:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:0.0:1788846172.086837:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:0.0:1788846172.086842:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875740683524608:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788846172.086870:0:18618:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e9c95b52-bf21-4a43-abed-5b176d36d076@192.168.203.20@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1788846172.086911:0:18618:0:(genops.c:1385:class_connect()) connect: client e9c95b52-bf21-4a43-abed-5b176d36d076, cookie 0x21b4d56138272fac 00000004:00100000:0.0:1788846172.086942:0:18618:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788846172.087070:0:18618:0:(import.c:65:import_set_state_nolock()) ffff90e34295e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788846172.087103:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2397:x1875740683524608:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 259us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846172.087111:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788846172.087297:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846172.087359:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846172.087597:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683524864 00000100:00100000:2.0:1788846172.087605:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683524864 00000100:00100000:2.0:1788846172.087647:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:2.0:1788846172.087656:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2398:x1875740683524864:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846172.087702:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2398:x1875740683524864:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 48us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846172.087709:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:3.0:1788846172.093256:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846172.093595:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683524992 00000100:00100000:1.0:1788846172.093610:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683524992 00000100:00100000:1.0:1788846172.094323:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683525120 00000100:00100000:1.0:1788846172.094332:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683525120 00000100:00100000:2.0:1788846172.094418:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1788846172.094442:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2398:x1875740683524992:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846172.094619:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2398:x1875740683524992:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 188us (8169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846172.094628:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1788846172.094672:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788846172.094680:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2398:x1875740683525120:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846172.094736:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2398:x1875740683525120:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 56us (7376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846172.094743:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1788846172.095060:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683525376 00000100:00100000:3.0:1788846172.095067:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683525376 00000100:00100000:3.0:1788846172.095102:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1788846172.095108:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875740683525376:12345-192.168.203.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788846172.095139:0:17089:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e9c95b52-bf21-4a43-abed-5b176d36d076@192.168.203.20@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:3.0:1788846172.095201:0:17089:0:(genops.c:1385:class_connect()) connect: client e9c95b52-bf21-4a43-abed-5b176d36d076, cookie 0x21b4d56138272fb3 00000004:00100000:3.0:1788846172.095238:0:17089:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788846172.095355:0:17089:0:(import.c:65:import_set_state_nolock()) ffff90e474530000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788846172.095392:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2397:x1875740683525376:12345-192.168.203.20@tcp:38:mount.lustre.0 Request processed in 284us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846172.095407:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1788846172.097935:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846172.097989:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846172.098042:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683525632 00000100:00100000:3.0:1788846172.098054:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683525632 00000100:00100000:3.0:1788846172.098120:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683525248 00000100:00100000:3.0:1788846172.098123:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683525248 00000100:00100000:3.0:1788846172.098145:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1788846172.098157:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+7:15008:x1875740683525632:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788846172.098207:0:18618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788846172.098286:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+7:15008:x1875740683525632:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 131us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846172.098295:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1788846172.098313:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1788846172.098319:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+6:0:x1875740683525248:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788846172.098329:0:18618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788846172.098349:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+6:0:x1875740683525248:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846172.098356:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00080000:3.0:1788846172.098372:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788846172.101371:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846172.101514:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683525504 00000100:00100000:3.0:1788846172.101562:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683525504 00000100:00080000:0.0:1788846172.101710:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846172.103614:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846172.103644:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+6:0:x1875740683525504:12345-192.168.203.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788846172.103698:0:18618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788846172.103836:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+6:0:x1875740683525504:12345-192.168.203.20@tcp:41:mount.lustre.0 Request processed in 206us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846172.103845:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846172.106828:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846172.106952:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683525760 00000100:00100000:0.0:1788846172.106966:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683525760 00000100:00100000:0.0:1788846172.107060:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:0.0:1788846172.107071:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15008:x1875740683525760:12345-192.168.203.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788846172.107190:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15008:x1875740683525760:12345-192.168.203.20@tcp:40:mount.lustre.0 Request processed in 121us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846172.107198:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1788846172.109652:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846172.109692:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846172.109727:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846172.109856:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683525888 00000100:00100000:1.0:1788846172.109869:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683525888 00000100:00100000:1.0:1788846172.109920:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683526016 00000100:00100000:1.0:1788846172.109923:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683526016 00000100:00100000:1.0:1788846172.109944:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788846172.109953:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875740683525888:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788846172.110019:0:18598:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e9c95b52-bf21-4a43-abed-5b176d36d076@192.168.203.20@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:1.0:1788846172.110065:0:18598:0:(genops.c:1385:class_connect()) connect: client e9c95b52-bf21-4a43-abed-5b176d36d076, cookie 0x21b4d56138272fba 00002000:00100000:1.0:1788846172.110081:0:18598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e9c95b52-bf21-4a43-abed-5b176d36d076/ffff90e46e21e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788846172.110104:0:18598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788846172.110215:0:18598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788846172.110256:0:18598:0:(import.c:65:import_set_state_nolock()) ffff90e46e21c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846172.110337:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2397:x1875740683525888:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 384us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846172.110345:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:1.0:1788846172.110385:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:1.0:1788846172.110390:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875740683526016:12345-192.168.203.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788846172.110416:0:18598:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e9c95b52-bf21-4a43-abed-5b176d36d076@192.168.203.20@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:1.0:1788846172.110435:0:18598:0:(genops.c:1385:class_connect()) connect: client e9c95b52-bf21-4a43-abed-5b176d36d076, cookie 0x21b4d56138272fc1 00002000:00100000:1.0:1788846172.110441:0:18598:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e9c95b52-bf21-4a43-abed-5b176d36d076/ffff90e46e21d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788846172.110447:0:18598:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788846172.110496:0:18598:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788846172.110511:0:18598:0:(import.c:65:import_set_state_nolock()) ffff90e46e21d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788846172.110570:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2397:x1875740683526016:12345-192.168.203.20@tcp:8:mount.lustre.0 Request processed in 178us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846172.110578:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:0.0:1788846172.112287:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683526144 00000100:00100000:0.0:1788846172.112305:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683526144 00000100:00100000:0.0:1788846172.112383:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1788846172.112395:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15008:x1875740683526144:12345-192.168.203.20@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788846172.112555:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15008:x1875740683526144:12345-192.168.203.20@tcp:900:mount.lustre.0 Request processed in 128us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846172.112564:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:2.0:1788846172.117898:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846172.118042:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683526272 00000100:00100000:0.0:1788846172.118055:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683526272 00000100:00100000:0.0:1788846172.118123:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:0.0:1788846172.118136:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15008:x1875740683526272:12345-192.168.203.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788846172.118257:0:17092:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788846172.118373:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15008:x1875740683526272:12345-192.168.203.20@tcp:33:mount.lustre.0 Request processed in 239us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846172.118381:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1788846172.296338:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846172.296568:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683526400 00000100:00100000:3.0:1788846172.296582:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683526400 00000100:00100000:3.0:1788846172.296662:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1788846172.296674:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15044:x1875740683526400:12345-192.168.203.20@tcp:101:mkdir.0 00010000:00010000:3.0:1788846172.296701:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846172.296730:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217549c8 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846172.296817:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846172.296834:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846172.296850:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846172.296905:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788846172.296909:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846172.296934:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846172.296964:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357a00/0x21b4d56138272fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846172.296998:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846172.297035:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e45176fa00) 00010000:00010000:3.0:1788846172.297038:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846172.297041:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357e00, rc 0) 00000100:00100000:3.0:1788846172.297183:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+7:15044:x1875740683526400:12345-192.168.203.20@tcp:101:mkdir.0 Request processed in 510us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846172.297192:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00010000:00010000:1.0:1788846172.858030:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846173.892075:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846174.521786:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846174.521811:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702474112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788846174.521898:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846174.522008:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702474112 00000100:00100000:0.0:1788846174.522017:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702474112 00000100:00100000:0.0:1788846174.522095:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846174.522106:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702474112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788846174.522132:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788846174.522182:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702474112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846174.522189:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788846174.522238:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702474112:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788846174.522301:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788846174.905659:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846175.035517:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702474240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846175.035603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846175.036814:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788846175.036826:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702474368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846175.036879:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846175.037272:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702474240 00000100:00100000:0.0:1788846175.037282:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702474240 00000100:00100000:0.0:1788846175.037322:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702474368 00000100:00100000:0.0:1788846175.037325:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702474368 00000100:00100000:0.0:1788846175.037342:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788846175.037359:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702474240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788846175.037391:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788846175.037448:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702474240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846175.037455:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788846175.037474:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788846175.037480:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702474368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788846175.037496:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788846175.037552:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702474368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846175.037558:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788846175.037595:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702474368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788846175.037607:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702474240:0@lo:41:osp-pre-1-0.0 00000001:00100000:2.0:1788846175.042487:0:19412:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00100000:2.0:1788846175.042499:0:19412:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000001:00100000:3.0:1788846175.042917:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00100000:3.0:1788846175.042924:0:17068:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000001:00100000:3.0:1788846175.043150:0:18592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00100000:3.0:1788846175.043157:0:18592:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000001:00100000:2.0:1788846175.043391:0:17821:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e9c95b52-bf21-4a43-abed-5b176d36d076 00000001:00100000:2.0:1788846175.043397:0:17821:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 53da1059-0b4b-4ba8-a35c-806ac864d7eb 00000001:02000400:0.0:1788846175.435890:0:19968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788846175.929856:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846176.057837:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788846176.057869:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702474496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846176.057990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.058054:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702474624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846176.058080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846176.058176:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702474496 00000100:00100000:0.0:1788846176.058188:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702474496 00000100:00100000:3.0:1788846176.058265:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702474752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788846176.058297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.071416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702475264:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.071545:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.071589:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702475776:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.071614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.071637:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788846176.071644:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702474880:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.071676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.071712:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702475392:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.071741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.071763:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702475904:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.071785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.071832:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702474880 00000100:00100000:3.0:1788846176.071843:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702474880 00000100:00100000:0.0:1788846176.072108:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702474624 00000100:00100000:0.0:1788846176.072113:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702474624 00000100:00100000:0.0:1788846176.072127:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702475264 00000100:00100000:0.0:1788846176.072129:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702475264 00000100:00100000:0.0:1788846176.072164:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702475776 00000100:00100000:0.0:1788846176.072165:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702475776 00000100:00100000:0.0:1788846176.072178:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702475904 00000100:00100000:0.0:1788846176.072179:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702475904 00000100:00100000:0.0:1788846176.072199:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788846176.073927:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702475264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846176.074077:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875740702475264:12345-0@lo:400:kworker.0 Request processed in 1868us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.074105:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788846176.074146:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788846176.074157:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702475776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846176.074197:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702475776:12345-0@lo:400:kworker.0 Request processed in 44us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.074202:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788846176.074223:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788846176.074235:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702475904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846176.074454:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702475904:12345-0@lo:400:kworker.0 Request processed in 223us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.074461:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788846176.074651:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702474752 00000100:00100000:0.0:1788846176.074661:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702474752 00000100:00100000:0.0:1788846176.074684:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788846176.074692:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702474496:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846176.074717:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00002000:00000024:0.0:1788846176.074722:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788846176.074733:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702474880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846176.074771:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702474496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (16780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.074779:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788846176.074795:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443215450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702474880:12345-0@lo:400:kworker.0 Request processed in 67us (3116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.074798:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788846176.074809:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788846176.074810:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702474624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788846176.074831:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788846176.074857:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702475392 00000100:00100000:3.0:1788846176.074864:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702475392 00000100:00100000:0.0:1788846176.074868:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702474624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (16786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.074876:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788846176.074892:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788846176.074922:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788846176.074927:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846176.074930:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846176.074934:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788846176.074945:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702474752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788846176.074958:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788846176.075008:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702474752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (16710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846176.075058:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788846176.075067:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702475392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075104:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702475392:12345-0@lo:400:kworker.0 Request processed in 40us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846176.075111:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788846176.075156:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702475136:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075208:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.075243:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702475648:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075268:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.075291:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702476160:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075310:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.075354:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702474624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788846176.075371:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702474496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788846176.075403:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788846176.075410:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702475008:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075437:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.075457:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702475520:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075479:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.075503:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702476032:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075555:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846176.075584:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702475648 00000100:00100000:3.0:1788846176.075589:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702475648 00000100:00100000:3.0:1788846176.075610:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702476160 00000100:00100000:3.0:1788846176.075613:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702476160 00000100:00100000:3.0:1788846176.075635:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702476032 00000100:00100000:3.0:1788846176.075638:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702476032 00000100:00100000:3.0:1788846176.075657:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788846176.075665:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702475648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075707:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875740702475648:12345-0@lo:400:kworker.0 Request processed in 42us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846176.075715:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788846176.075735:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788846176.075744:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788846176.075748:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702476160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075756:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702476032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846176.075797:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875740702476160:12345-0@lo:400:kworker.0 Request processed in 52us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846176.075804:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875740702476032:12345-0@lo:400:kworker.0 Request processed in 51us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846176.075811:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788846176.075819:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788846176.075848:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3643:1875740702476032:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.075859:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875740702475648:0@lo:400:kworker.0 00010000:00080000:3.0:1788846176.075873:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e344439880 x1875740702476160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788846176.075875:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702475136 00000100:00100000:0.0:1788846176.075881:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702475136 00000100:00100000:0.0:1788846176.075908:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702475520 00000100:00100000:0.0:1788846176.075911:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702475520 00000100:00100000:0.0:1788846176.075934:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788846176.075941:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702475136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846176.075985:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875740702475136:12345-0@lo:400:kworker.0 Request processed in 34us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.075992:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788846176.076005:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788846176.076011:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702475520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846176.076039:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702475520:12345-0@lo:400:kworker.0 Request processed in 29us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.076045:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788846176.076074:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788846176.076078:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788846176.076080:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788846176.076126:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702475008 00000100:00100000:0.0:1788846176.076131:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702475008 00000100:00100000:0.0:1788846176.076157:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788846176.076174:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702475008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788846176.076207:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702475008:12345-0@lo:400:kworker.0 Request processed in 44us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846176.076221:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788846176.076684:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702474880:0@lo:400:kworker.0 00000100:00100000:2.0:1788846176.077850:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702475392:0@lo:400:kworker.0 00010000:00080000:2.0:1788846176.077889:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e34443bb80 x1875740702475904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846176.077901:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702475904:0@lo:400:kworker.0 00000100:00100000:2.0:1788846176.077919:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875740702475264:0@lo:400:kworker.0 00000100:00100000:2.0:1788846176.077934:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702475776:0@lo:400:kworker.0 00000100:00100000:2.0:1788846176.077962:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702474752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846176.078332:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788846176.078703:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3643:1875740702476160:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.078746:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702475008:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.078760:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702475520:0@lo:400:kworker.0 00000100:00100000:3.0:1788846176.078773:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702475136:0@lo:400:kworker.0 00010000:00010000:3.0:1788846176.953918:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846177.141914:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.141963:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.141998:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.142035:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.142222:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.142250:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.142272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.142298:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.142321:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846177.142346:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683526528 00000100:00100000:3.0:1788846177.142360:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683526528 00000100:00100000:3.0:1788846177.142404:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:3.0:1788846177.142414:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2400:x1875740683526528:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846177.142475:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2400:x1875740683526528:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 63us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846177.142482:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 145 00000100:00100000:3.0:1788846177.142511:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683526784 00000100:00100000:3.0:1788846177.142515:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683526784 00000100:00100000:3.0:1788846177.142565:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683527296 00000100:00100000:3.0:1788846177.142568:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683527296 00000100:00100000:3.0:1788846177.142580:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683526656 00000100:00100000:3.0:1788846177.142583:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683526656 00000100:00100000:3.0:1788846177.142595:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683527168 00000100:00100000:3.0:1788846177.142597:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683527168 00000100:00100000:3.0:1788846177.142610:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:3.0:1788846177.142617:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683526784:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846177.142645:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683526784:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 29us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846177.142652:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:3.0:1788846177.142663:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:3.0:1788846177.142669:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683527296:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846177.142690:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683527296:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846177.142696:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:3.0:1788846177.142706:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:3.0:1788846177.142711:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2400:x1875740683526656:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846177.142753:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2400:x1875740683526656:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846177.142760:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:3.0:1788846177.142771:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1788846177.142777:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2400:x1875740683527168:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846177.142795:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2400:x1875740683527168:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 19us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846177.142800:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1788846177.142814:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683527040 00000100:00100000:3.0:1788846177.142817:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683527040 00000100:00100000:3.0:1788846177.142838:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683527552 00000100:00100000:3.0:1788846177.142841:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683527552 00000100:00100000:3.0:1788846177.142851:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683526912 00000100:00100000:3.0:1788846177.142853:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683526912 00000100:00100000:3.0:1788846177.142863:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683527424 00000100:00100000:3.0:1788846177.142865:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683527424 00000100:00100000:3.0:1788846177.142876:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:3.0:1788846177.142881:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683527040:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846177.142886:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:1.0:1788846177.142893:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683527552:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846177.142904:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683527040:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846177.142910:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:1.0:1788846177.142913:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683527552:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846177.142919:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:3.0:1788846177.142922:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:3.0:1788846177.142928:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683526912:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846177.142929:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:1.0:1788846177.142934:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683527424:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846177.142947:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683526912:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 19us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846177.142947:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683527424:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 14us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846177.142953:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:3.0:1788846177.142960:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00080000:2.0:1788846177.143202:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788846177.143207:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788846177.143209:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788846177.143212:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788846177.342484:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788846177.999122:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788846178.970473:0:20115:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2807c4a0 20000000:00000080:0.0:1788846178.970490:0:20115:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90e474560000 uarg=0000000000000000 20000000:01000000:0.0:1788846178.970937:0:20115:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788846178.970943:0:20115:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788846178.970948:0:20115:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788846178.972299:0:20116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788846178.972514:0:20115:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788846178.984693:0:20115:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788846178.984839:0:20115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984855:0:20115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c64 expref: 23 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984860:0:20115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272c72 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984880:0:20115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984887:0:20115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272d4b expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984896:0:20115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984903:0:20115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 12 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984910:0:20115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984953:0:20115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 12 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.984982:0:20115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 12 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846178.984997:0:20115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476288:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846178.985086:0:20115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.985092:0:20115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 12 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846178.985098:0:20115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476416:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846178.985134:0:20115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272d4b expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.985143:0:20115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272d4b expref: 23 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846178.985153:0:20115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476544:0@lo:104: 00000100:00100000:1.0:1788846178.985190:0:20115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846178.985232:0:20115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 23 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.985241:0:20115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 23 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846178.985250:0:20115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476672:0@lo:104: 00000100:00100000:1.0:1788846178.985272:0:20115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846178.985304:0:20115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272c72 expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.985313:0:20115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272c72 expref: 23 pid: 17082 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846178.985320:0:20115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476800:0@lo:104: 00000100:00100000:1.0:1788846178.985340:0:20115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846178.985358:0:20115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x21b4d56138272c64 expref: 23 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.985367:0:20115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x21b4d56138272c64 expref: 23 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846178.985387:0:20115:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476928:0@lo:104: 00000100:00100000:1.0:1788846178.985424:0:20115:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846178.985438:0:20115:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846178.985712:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702476544 00000100:00100000:3.0:1788846178.985721:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702476544 00000100:00100000:0.0:1788846178.985732:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702476672 00000100:00100000:0.0:1788846178.985735:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702476672 00000100:00100000:3.0:1788846178.985758:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702476928 00000100:00100000:0.0:1788846178.985758:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702476800 00000100:00100000:3.0:1788846178.985760:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702476928 00000100:00100000:0.0:1788846178.985760:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702476800 00000100:00100000:3.0:1788846178.985773:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788846178.985782:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+6:20115:x1875740702476672:12345-0@lo:104: 00010000:00010000:3.0:1788846178.985795:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.985887:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788846178.985894:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+6:20115:x1875740702476672:12345-0@lo:104: Request processed in 112us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846178.985901:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788846178.985919:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788846178.985924:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+5:20115:x1875740702476544:12345-0@lo:104: 00010000:00010000:3.0:1788846178.985932:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.985975:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788846178.985980:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+5:20115:x1875740702476544:12345-0@lo:104: Request processed in 57us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846178.985986:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788846178.985997:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846178.986002:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:20115:x1875740702476928:12345-0@lo:104: 00010000:00010000:3.0:1788846178.986017:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986048:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788846178.986053:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342580000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+4:20115:x1875740702476928:12345-0@lo:104: Request processed in 51us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846178.986058:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846178.986069:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846178.986075:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:20115:x1875740702476800:12345-0@lo:104: 00010000:00010000:3.0:1788846178.986082:0:17071:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986108:0:17071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788846178.986113:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+3:20115:x1875740702476800:12345-0@lo:104: Request processed in 39us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846178.986119:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788846178.986135:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788846178.986141:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986148:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475064800 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846178.986151:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986159:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846178.986166:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846178.986179:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788846178.986213:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986219:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846178.986239:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986246:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475064800/0x21b4d56138272cb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272cb8 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986259:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788846178.986262:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986268:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3c00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846178.986271:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986278:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846178.986284:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846178.986289:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788846178.986300:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986306:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846178.986319:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986325:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3c00/0x21b4d56138272d4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272d52 expref: -99 pid: 19411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986334:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788846178.986337:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986343:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42da00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846178.986346:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986352:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846178.986358:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846178.986363:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788846178.986377:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986383:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846178.986398:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986405:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e46d42da00/0x21b4d56138272c64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c6b expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986423:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788846178.986426:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986431:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e475065e00 already unused, calling callback (ffffffffc1406c20) 10000000:00010000:3.0:1788846178.986434:0:17076:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986441:0:17076:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788846178.986447:0:17076:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846178.986451:0:17076:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788846178.986466:0:17076:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986471:0:17076:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788846178.986477:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986484:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.120@tcp lock: ffff90e475065e00/0x21b4d56138272c72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x21b4d56138272c79 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.986497:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846178.986499:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846178.986501:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846178.986507:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788846178.986539:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846178.986553:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702477056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846178.986586:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846178.986617:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788846178.986623:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702477184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788846178.986643:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846178.986678:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702477312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846178.986682:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702477056 00000100:00100000:1.0:1788846178.986687:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702477056 00000100:00100000:3.0:1788846178.986701:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846178.986713:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 24 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846178.986718:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788846178.986723:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702477440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846178.986728:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702477184 00000100:00100000:1.0:1788846178.986730:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702477184 00000100:00100000:3.0:1788846178.986741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788846178.986741:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272d4b expref: 25 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846178.986751:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702477312 00000100:00100000:1.0:1788846178.986753:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702477312 00000100:00100000:3.0:1788846178.986760:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702477440 00000100:00100000:3.0:1788846178.986763:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702477440 00010000:00010000:3.0:1788846178.986775:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c72 expref: 27 pid: 17082 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.986776:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c64 expref: 27 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846178.986789:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788846178.986862:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788846178.986875:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+27:3640:x1875740702477184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788846178.986886:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846178.986891:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272d4b expref: 27 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.986900:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272d4b expref: 27 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.986916:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788846178.986970:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6db0807f-6150-4b75-b37b-0ed71f62ed94+27:3640:x1875740702477184:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846178.986984:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788846178.986997:0:17074:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788846178.987005:0:17074:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788846178.987164:0:20115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064c00/0x21b4d56138272d52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272d4b expref: 26 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846178.987176:0:20115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476544:0@lo:104: 00000100:00100000:0.0:1788846178.987186:0:20115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476672:0@lo:104: 00000100:00100000:0.0:1788846178.987194:0:20115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476800:0@lo:104: 00000100:00100000:0.0:1788846178.987201:0:20115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476928:0@lo:104: 00000100:00100000:3.0:1788846178.987279:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+25:3640:x1875740702477056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846178.987289:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846178.987294:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 25 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987389:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 25 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987410:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d600/0x21b4d56138272cb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272cb1 expref: 25 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987419:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846178.987449:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702477056:12345-0@lo:103:ldlm_bl.0 Request processed in 654us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846178.987464:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788846178.987479:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846178.987488:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:3642:x1875740702477312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846178.987495:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846178.987498:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c64 expref: 23 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987506:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272c64 expref: 23 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987515:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e475064400/0x21b4d56138272c6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272c64 expref: 23 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987574:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846178.987610:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:3642:x1875740702477312:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846178.987616:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788846178.987629:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788846178.987637:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:3642:x1875740702477440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788846178.987644:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846178.987647:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x21b4d56138272c72 expref: 21 pid: 17082 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987655:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x21b4d56138272c72 expref: 21 pid: 17082 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987663:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e46d42d800/0x21b4d56138272c79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x21b4d56138272c72 expref: 21 pid: 17082 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846178.987677:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846178.987702:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:3642:x1875740702477440:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846178.987707:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788846178.988169:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702477440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788846178.988184:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6db0807f-6150-4b75-b37b-0ed71f62ed94:3642:1875740702477312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846178.989100:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702477184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788846178.989112:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702477056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788846178.989896:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846178.990044:0:20115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476288:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846178.990056:0:20115:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20115:1875740702476416:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846178.990089:0:20115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846178.990199:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683527680 00000100:00100000:2.0:1788846178.990207:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683527680 00010000:00010000:2.0:1788846178.990234:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 13 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846178.990282:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1788846178.990291:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f27dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2398:x1875740683527680:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846178.990304:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846178.990310:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 13 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846178.990320:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 13 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846178.990337:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e342a0d800/0x21b4d56138272fa5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754997 expref: 13 pid: 17080 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846178.990349:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846178.990490:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f27dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:2398:x1875740683527680:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 199us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846178.990498:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:2.0:1788846178.998511:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846178.998691:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683527808 00000100:00100000:1.0:1788846178.998702:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683527808 00010000:00010000:1.0:1788846178.998750:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 12 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846178.998788:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:1.0:1788846178.998799:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:2401:x1875740683527808:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846178.998814:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846178.998820:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 12 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998833:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 12 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998851:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2400/0x21b4d56138272f66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754927 expref: 12 pid: 17083 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998888:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998897:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998912:0:17074:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998919:0:17074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998924:0:17074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998930:0:17074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998941:0:17074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e2600 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846178.998945:0:17074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998961:0:17074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998987:0:17074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846178.998998:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846178.999156:0:20115:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846178.999165:0:20115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846178.999171:0:20115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90e47d1e2600/0x21b4d56138272fd6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846179.000092:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:2401:x1875740683527808:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1287us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846179.000109:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00010000:00010000:1.0:1788846179.002672:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846179.642396:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e344439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702477568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846179.642478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846179.648752:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702477568 00000100:00100000:1.0:1788846179.648768:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702477568 00000100:00100000:1.0:1788846179.648836:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788846179.648848:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702477568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788846179.648881:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788846179.648971:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702477568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (6493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846179.648979:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788846179.649000:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846179.649043:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e344439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702477568:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788846180.026741:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788846180.092565:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788846180.155964:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702477696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846180.156034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846180.156323:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702477696 00000100:00100000:1.0:1788846180.156331:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702477696 00000100:00100000:1.0:1788846180.156376:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788846180.156385:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702477696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846180.156417:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846180.156463:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702477696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846180.156470:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788846180.156536:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702477696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788846180.157976:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788846180.157994:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702477824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788846180.158054:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846180.158092:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702477824 00000100:00100000:2.0:1788846180.158099:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702477824 00000100:00100000:2.0:1788846180.158137:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788846180.158145:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702477824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846180.158174:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788846180.158214:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702477824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.158221:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788846180.158257:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702477824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846180.271748:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846180.271786:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683527936 00000100:00100000:1.0:1788846180.271795:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683527936 00000100:00100000:1.0:1788846180.271921:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:1.0:1788846180.271932:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+11:14891:x1875740683527936:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846180.271963:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846180.271983:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e47d1e2000/0x21b4d56138272fdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217549cf expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.272014:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e47d1e2000/0x21b4d56138272fdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549cf expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.272025:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e47d1e2000/0x21b4d56138272fdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549cf expref: 12 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.272034:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2000, rc 0) 00000100:00100000:1.0:1788846180.272092:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:14891:x1875740683527936:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 162us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846180.272100:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 146 00000100:00100000:3.0:1788846180.289050:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846180.310259:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683528064 00000100:00100000:2.0:1788846180.310275:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683528064 00000100:00100000:2.0:1788846180.310345:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:2.0:1788846180.310355:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:14891:x1875740683528064:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.310545:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:14891:x1875740683528064:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 191us (21505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.310559:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 147 00000100:00100000:2.0:1788846180.320607:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846180.320649:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683528192 00000100:00100000:2.0:1788846180.320658:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683528192 00000100:00100000:2.0:1788846180.320705:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:2.0:1788846180.320715:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:14891:x1875740683528192:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.320841:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443217850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:14891:x1875740683528192:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 127us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.320850:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 148 00000100:00100000:3.0:1788846180.327250:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846180.327497:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683528320 00000100:00100000:0.0:1788846180.327508:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683528320 00000100:00100000:0.0:1788846180.327595:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:0.0:1788846180.327606:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+12:14891:x1875740683528320:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788846180.327622:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846180.327640:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342a0dc00/0x21b4d56138272fe4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217549d6 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846180.327689:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342a0dc00/0x21b4d56138272fe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549d6 expref: 13 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846180.327702:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342a0dc00/0x21b4d56138272fe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549d6 expref: 13 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846180.327712:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0dc00, rc 0) 00000100:00100000:0.0:1788846180.328015:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:14891:x1875740683528320:12345-192.168.203.20@tcp:101:ll_cfg_requeue.0 Request processed in 409us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846180.328023:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 149 00000100:00100000:2.0:1788846180.336363:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846180.339887:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683528448 00000100:00100000:3.0:1788846180.339901:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683528448 00000100:00100000:3.0:1788846180.339969:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 150 00000100:00100000:3.0:1788846180.339980:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:14891:x1875740683528448:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846180.340195:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443216850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:14891:x1875740683528448:12345-192.168.203.20@tcp:501:ll_cfg_requeue.0 Request processed in 216us (3840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846180.340205:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 150 10000000:01000000:1.0:1788846180.352001:0:17086:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788846180.352009:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e344565000 from 13 10000000:01000000:1.0:1788846180.352014:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788846180.352055:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.352066:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.352077:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846180.352100:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702477952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.352164:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846180.352212:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846180.352644:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702477952 00000100:00100000:3.0:1788846180.352652:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702477952 00000100:00100000:3.0:1788846180.353295:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788846180.353308:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e443214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+20:17086:x1875740702477952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846180.353322:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846180.353337:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441357a00/0x21b4d56138272ff2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272feb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.353370:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441357a00/0x21b4d56138272ff2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272feb expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.353381:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441357a00/0x21b4d56138272ff2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272feb expref: 21 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.353390:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441357a00, rc 0) 00000100:00100000:3.0:1788846180.353451:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e443214c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702477952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846180.353458:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788846180.353561:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702477952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846180.353578:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.353589:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846180.353662:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.353690:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846180.367813:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702478080 00000100:00100000:2.0:1788846180.367831:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702478080 00000100:00100000:2.0:1788846180.367890:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788846180.367899:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45356a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702478080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.368063:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45356a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702478080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (14372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.368072:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788846180.371009:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846180.371046:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683528576 00000100:00100000:2.0:1788846180.371055:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683528576 00000100:00100000:2.0:1788846180.371093:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:2.0:1788846180.371103:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e446729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:14891:x1875740683528576:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.371239:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e446729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:14891:x1875740683528576:12345-192.168.203.20@tcp:503:ll_cfg_requeue.0 Request processed in 137us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.371247:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 153 00000100:00100000:2.0:1788846180.371385:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846180.371409:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342580380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.371453:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.371492:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846180.371514:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702478208 00000100:00100000:2.0:1788846180.371998:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702478208 00000100:00100000:2.0:1788846180.372028:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788846180.372034:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e446728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702478208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.372113:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e446728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702478208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.372126:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788846180.372167:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788846180.372180:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846180.374087:0:20182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788846180.374300:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788846180.374326:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788846180.374337:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.374349:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e47d1e3800/0x21b4d56138272feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138272ff2 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788846180.374359:0:17086:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788846180.374361:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e47f491800 from 13 10000000:01000000:2.0:1788846180.374364:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788846180.374397:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.374405:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.374416:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846180.374439:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.374496:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846180.374646:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3428f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788846180.374805:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702478336 00000100:00100000:3.0:1788846180.374812:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702478336 00000100:00100000:3.0:1788846180.374858:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788846180.374867:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44672ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+21:17086:x1875740702478336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846180.374878:0:17080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846180.374889:0:17080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e441356200/0x21b4d56138273000 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138272ff9 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.374910:0:17080:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e441356200/0x21b4d56138273000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138272ff9 expref: 22 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.374920:0:17080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e441356200/0x21b4d56138273000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138272ff9 expref: 22 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.374927:0:17080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e441356200, rc 0) 00000100:00100000:3.0:1788846180.374977:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44672ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:17086:x1875740702478336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846180.374996:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788846180.376570:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846180.376595:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.376607:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846180.376685:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342581f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.376731:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846180.376765:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846180.376815:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702478464 00000100:00100000:2.0:1788846180.376821:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702478464 00000100:00100000:2.0:1788846180.376873:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788846180.376892:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44672a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:17086:x1875740702478464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.377430:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44672a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:17086:x1875740702478464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 538us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.377438:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788846180.382672:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342581f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.382742:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342581f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.382821:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846180.382871:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788846180.383506:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702478592 00000100:00100000:2.0:1788846180.383515:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702478592 00000100:00100000:2.0:1788846180.383585:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788846180.383595:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:17086:x1875740702478592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.383738:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:17086:x1875740702478592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.383749:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788846180.388417:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342581f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788846180.389231:0:20183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788846180.389629:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788846180.389662:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788846180.390020:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.390033:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e342aaa600/0x21b4d56138272ff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d56138273000 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788846180.390044:0:17086:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788846180.390047:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e475188800 from 13 10000000:01000000:3.0:1788846180.390050:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788846180.390084:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.390092:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.390102:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846180.390125:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788846180.390192:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846180.390274:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cf240 going to sleep for 11 seconds 00000100:00100000:2.0:1788846180.390415:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702478720 00000100:00100000:2.0:1788846180.390423:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702478720 00000100:00100000:2.0:1788846180.390510:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788846180.390538:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+22:17086:x1875740702478720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846180.390551:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846180.390564:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aab200/0x21b4d5613827300e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273007 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.390586:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aab200/0x21b4d5613827300e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273007 expref: 23 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.390596:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aab200/0x21b4d5613827300e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273007 expref: 23 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.390605:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aab200, rc 0) 00000100:00100000:2.0:1788846180.390647:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702478720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.390665:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788846180.390691:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788846180.390715:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.390724:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846180.390778:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.390809:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846180.390839:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788846180.390875:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702478848 00000100:00100000:2.0:1788846180.390880:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702478848 00000100:00100000:2.0:1788846180.390915:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788846180.390922:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702478848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.391033:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702478848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.391040:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788846180.391147:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.391175:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.391214:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846180.391238:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788846180.391276:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702478976 00000100:00100000:2.0:1788846180.391280:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702478976 00000100:00100000:2.0:1788846180.391308:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788846180.391315:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702478976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788846180.391387:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702478976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.391393:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788846180.391460:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702478976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788846180.392364:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788846180.392623:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788846180.392642:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788846180.392652:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.392662:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e441356000/0x21b4d56138273007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827300e expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788846180.392671:0:17086:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788846180.392910:0:17086:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90e344550800 from 13 10000000:01000000:1.0:1788846180.392914:0:17086:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788846180.392956:0:17086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.392979:0:17086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.392990:0:17086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846180.393009:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e342583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702479104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.393110:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846180.393174:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4745a8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788846180.393217:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702479104 00000100:00100000:2.0:1788846180.393225:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702479104 00000100:00100000:2.0:1788846180.393298:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788846180.393305:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+23:17086:x1875740702479104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788846180.393315:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846180.393327:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90e342aaa000/0x21b4d5613827301c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x21b4d56138273015 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.393347:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90e342aaa000/0x21b4d5613827301c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x21b4d56138273015 expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.393368:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90e342aaa000/0x21b4d5613827301c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x21b4d56138273015 expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846180.393376:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa000, rc 0) 00000100:00100000:2.0:1788846180.393422:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:17086:x1875740702479104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846180.393428:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788846180.393505:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e342583480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702479104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788846180.393536:0:17086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846180.393552:0:17086:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846180.393605:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702479232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846180.393633:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846180.394214:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702479232 00000100:00100000:1.0:1788846180.394220:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702479232 00000100:00100000:1.0:1788846180.394248:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788846180.394256:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:17086:x1875740702479232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.394359:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:17086:x1875740702479232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846180.394366:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788846180.395434:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846180.395459:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702479232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788846180.395513:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702479360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788846180.395592:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846180.395612:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4464cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788846180.395830:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702479360 00000100:00100000:1.0:1788846180.395836:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702479360 00000100:00100000:1.0:1788846180.395874:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788846180.395882:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:17086:x1875740702479360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788846180.396001:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:17086:x1875740702479360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846180.396010:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788846180.396029:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6db0807f-6150-4b75-b37b-0ed71f62ed94:17086:1875740702479360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788846180.398501:0:20186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788846180.398659:0:17086:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788846180.398684:0:17086:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788846180.398695:0:17086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846180.398713:0:17086:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.120@tcp lock: ffff90e47d1e2400/0x21b4d56138273015 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x21b4d5613827301c expref: -99 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846181.050498:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846181.177733:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702479488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846181.177797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178139:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702479616:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178200:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702480128:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178224:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178242:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702480640:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178287:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788846181.178293:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702479744:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178328:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702480256:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178351:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178368:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702480768:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178408:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702479872:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178442:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178460:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702480384:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178479:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178494:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702480896:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178513:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178547:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788846181.178553:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702480000:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178573:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178589:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e343bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702480512:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178608:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178617:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702481024:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178635:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.178661:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702479616 00000100:00100000:2.0:1788846181.178668:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702479616 00000100:00100000:2.0:1788846181.178712:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788846181.178719:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702479616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178764:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3640:x1875740702479616:12345-0@lo:400:kworker.0 Request processed in 45us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.178771:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788846181.178803:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702480128 00000100:00100000:2.0:1788846181.178807:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702480128 00000100:00100000:2.0:1788846181.178828:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702479744 00000100:00100000:2.0:1788846181.178831:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702479744 00000100:00100000:2.0:1788846181.178845:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788846181.178851:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702480128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178884:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702480128:12345-0@lo:400:kworker.0 Request processed in 33us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.178897:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788846181.178910:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788846181.178915:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702479744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.178956:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875740702479744:12345-0@lo:400:kworker.0 Request processed in 40us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.178961:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788846181.178979:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702480640 00000100:00100000:2.0:1788846181.178984:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702480640 00000100:00100000:2.0:1788846181.179011:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702480768 00000100:00100000:2.0:1788846181.179013:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702480768 00000100:00100000:2.0:1788846181.179024:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702480896 00000100:00100000:2.0:1788846181.179027:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702480896 00000100:00100000:2.0:1788846181.179049:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702480000 00000100:00100000:2.0:1788846181.179052:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702480000 00000100:00100000:2.0:1788846181.179064:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702480512 00000100:00100000:2.0:1788846181.179066:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702480512 00000100:00100000:2.0:1788846181.179077:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702481024 00000100:00100000:2.0:1788846181.179079:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702481024 00000100:00100000:2.0:1788846181.179092:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788846181.179097:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702480640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179126:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875740702480640:12345-0@lo:400:kworker.0 Request processed in 29us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179134:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788846181.179146:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788846181.179152:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702480768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179176:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875740702480768:12345-0@lo:400:kworker.0 Request processed in 25us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179181:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788846181.179201:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788846181.179207:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702480896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179240:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875740702480896:12345-0@lo:400:kworker.0 Request processed in 33us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179245:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788846181.179256:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788846181.179262:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702480000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179287:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702480000:12345-0@lo:400:kworker.0 Request processed in 25us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179292:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788846181.179303:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788846181.179308:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702480512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179331:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702480512:12345-0@lo:400:kworker.0 Request processed in 23us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179337:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788846181.179347:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788846181.179352:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702481024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179376:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702481024:12345-0@lo:400:kworker.0 Request processed in 24us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179382:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788846181.179404:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702480256 00000100:00100000:2.0:1788846181.179407:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702480256 00000100:00100000:2.0:1788846181.179432:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702479872 00000100:00100000:2.0:1788846181.179435:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702479872 00000100:00100000:2.0:1788846181.179449:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702480384 00000100:00100000:2.0:1788846181.179451:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702480384 00000100:00100000:2.0:1788846181.179463:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846181.179476:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702480256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179508:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1875740702480256:12345-0@lo:400:kworker.0 Request processed in 33us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179513:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788846181.179546:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788846181.179552:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702479872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179578:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702479872:12345-0@lo:400:kworker.0 Request processed in 26us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179583:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788846181.179593:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788846181.179599:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702480384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179624:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702480384:12345-0@lo:400:kworker.0 Request processed in 26us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.179629:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788846181.179666:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788846181.179670:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788846181.179672:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788846181.179674:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846181.179701:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3640:1875740702479744:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179712:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702480256:0@lo:400:kworker.0 00010000:00080000:2.0:1788846181.179723:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e343baf800 x1875740702480768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846181.179732:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3640:1875740702480768:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179739:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6db0807f-6150-4b75-b37b-0ed71f62ed94:3640:1875740702479616:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179759:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3640:1875740702480128:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179768:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3640:1875740702480640:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179805:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702480000:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179815:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702480512:0@lo:400:kworker.0 00010000:00080000:2.0:1788846181.179825:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e3438e9c00 x1875740702481024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788846181.179833:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702481024:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179841:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343bae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702479872:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179850:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e343baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702480384:0@lo:400:kworker.0 00000100:00100000:2.0:1788846181.179859:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3642:1875740702480896:0@lo:400:kworker.0 00000100:00100000:1.0:1788846181.182617:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702479488 00000100:00100000:1.0:1788846181.182630:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702479488 00000100:00100000:1.0:1788846181.182704:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788846181.182714:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702479488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788846181.182745:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788846181.182825:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875740702479488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846181.182831:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788846181.182889:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e34443bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3643:1875740702479488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846181.186092:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788846181.186117:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702481152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788846181.186185:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846181.186232:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702481152 00000100:00100000:2.0:1788846181.186240:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702481152 00000100:00100000:2.0:1788846181.186285:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788846181.186295:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702481152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788846181.186321:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788846181.186362:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702481152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846181.186369:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788846181.186413:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702481152:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788846181.186997:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788846181.193916:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3438eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702481280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788846181.193997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846181.194065:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702481280 00000100:00100000:0.0:1788846181.194073:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702481280 00000100:00100000:0.0:1788846181.194118:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788846181.194127:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702481280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788846181.194152:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788846181.194357:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702481280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 230us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846181.194365:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788846181.195994:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3438eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702481280:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788846182.073887:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846182.255172:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255215:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255255:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255275:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255291:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255306:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255580:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255611:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.255642:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683529216 00000100:00100000:3.0:1788846182.255653:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683529216 00000100:00100000:2.0:1788846182.255674:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683528704 00000100:00100000:2.0:1788846182.255681:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683528704 00000100:00100000:3.0:1788846182.255712:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683529728 00000100:00100000:3.0:1788846182.255717:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683529728 00000100:00100000:2.0:1788846182.255723:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:2.0:1788846182.255735:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2400:x1875740683528704:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846182.255738:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683529088 00000100:00100000:3.0:1788846182.255743:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683529088 00000100:00100000:3.0:1788846182.255777:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683529600 00000100:00100000:3.0:1788846182.255781:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683529600 00000100:00100000:3.0:1788846182.255800:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:2.0:1788846182.255809:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2400:x1875740683528704:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 75us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.255811:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683529216:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846182.255823:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 165 00000100:00100000:3.0:1788846182.255853:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683529216:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 44us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.255862:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1788846182.255880:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1788846182.255889:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683529728:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846182.255918:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683529728:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.255926:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1788846182.255959:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1788846182.255969:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683529088:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846182.255969:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683528960 00000100:00100000:2.0:1788846182.255976:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683528960 00000100:00100000:2.0:1788846182.256000:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683529472 00000100:00100000:2.0:1788846182.256003:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683529472 00000100:00100000:3.0:1788846182.256009:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683529088:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 42us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.256018:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1788846182.256018:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683528832 00000100:00100000:2.0:1788846182.256022:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683528832 00000100:00100000:2.0:1788846182.256039:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683529344 00000100:00100000:3.0:1788846182.256042:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1788846182.256043:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683529344 00000100:00100000:3.0:1788846182.256056:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683529600:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846182.256062:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:2.0:1788846182.256071:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683528960:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846182.256087:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683529600:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.256095:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:2.0:1788846182.256104:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2400:x1875740683528960:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 34us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846182.256111:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00080000:3.0:1788846182.256122:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788846182.256127:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00080000:3.0:1788846182.256129:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788846182.256134:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683529472:12345-192.168.203.20@tcp:400:kworker.0 00000100:00080000:3.0:1788846182.256143:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788846182.256146:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846182.256157:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2400:x1875740683529472:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 24us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846182.256163:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:2.0:1788846182.256183:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1788846182.256193:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1788846182.256194:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2400:x1875740683528832:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:3.0:1788846182.256209:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2400:x1875740683529344:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:2.0:1788846182.256221:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2400:x1875740683528832:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 31us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846182.256228:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1788846182.256248:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2400:x1875740683529344:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 42us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.256256:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:3.0:1788846182.416358:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.416455:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683529856 00000100:00100000:2.0:1788846182.416464:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683529856 00000100:00100000:2.0:1788846182.416555:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1788846182.416566:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:15561:x1875740683529856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846182.416585:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846182.416717:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217549dd expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.416780:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.416794:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.416805:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.416820:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.416827:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.416833:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417001:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273038 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417011:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273038 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417017:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273038 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846182.417047:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788846182.417051:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846182.417086:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273038 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417097:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417103:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417109:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417115:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846182.417119:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417126:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417135:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e45176fa00) 00010000:00010000:2.0:1788846182.417145:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846182.417150:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417155:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827302a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417169:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417174:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417179:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417184:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aabc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846182.417186:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417192:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417198:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90e46d443b00) 00010000:00010000:2.0:1788846182.417201:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846182.417203:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417208:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273031 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417238:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549dd expref: 8 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417264:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab800/0x21b4d56138273038 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549dd expref: 7 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.417271:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e46d443000) 00010000:00010000:2.0:1788846182.417273:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846182.417275:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aab800, rc 0) 00000100:00100000:2.0:1788846182.417343:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:15561:x1875740683529856:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 779us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846182.417350:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1788846182.425717:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.426747:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683529984 00000100:00100000:3.0:1788846182.426760:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683529984 00000100:00100000:3.0:1788846182.426822:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1788846182.426832:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:15561:x1875740683529984:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788846182.426918:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:15561:x1875740683529984:12345-192.168.203.20@tcp:900:lhsmtool_posix.0 Request processed in 88us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.426925:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:0.0:1788846182.431749:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.431837:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683530240 00000100:00100000:3.0:1788846182.431855:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683530240 00000100:00100000:3.0:1788846182.431920:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1788846182.431939:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:15561:x1875740683530240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846182.431958:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846182.431978:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827303f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217549e4 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432049:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432062:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432087:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432149:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432157:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432164:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432260:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138273054 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432267:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138273054 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432273:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138273054 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846182.432281:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788846182.432418:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432426:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432432:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432438:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441356600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846182.432448:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432456:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432468:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90e46d443000) 00010000:00010000:3.0:1788846182.432471:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846182.432474:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432481:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441356600/0x21b4d56138273046 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432492:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432499:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432504:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.432509:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e441357200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846182.432512:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.434141:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.434169:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90e45176f400) 00010000:00010000:3.0:1788846182.434172:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846182.434190:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.434198:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357200/0x21b4d5613827304d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.435787:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357400/0x21b4d5613827303f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549e4 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.435811:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d800/0x21b4d56138273054 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549e4 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.435819:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e45176f700) 00010000:00010000:2.0:1788846182.435822:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846182.435825:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d800, rc 0) 00000100:00100000:2.0:1788846182.436700:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3438eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15561:x1875740683530240:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 4765us (4954us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788846182.436710:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:0.0:1788846182.441968:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.442265:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683530368 00000100:00100000:3.0:1788846182.442276:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683530368 00000100:00100000:3.0:1788846182.442335:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:3.0:1788846182.442345:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15561:x1875740683530368:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788846182.442456:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15561:x1875740683530368:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 112us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.442465:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788846182.449967:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.450069:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683530496 00000100:00100000:2.0:1788846182.450079:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683530496 00000100:00100000:2.0:1788846182.450135:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1788846182.450144:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:15561:x1875740683530496:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788846182.452719:0:18618:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2529us 00000040:00080000:3.0:1788846182.461552:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788846182.465122:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:15561:x1875740683530496:12345-192.168.203.20@tcp:59:lhsmtool_posix.0 Request processed in 14968us (15153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846182.465136:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:0.0:1788846182.500996:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.501148:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683530624 00000100:00100000:3.0:1788846182.501159:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683530624 00000100:00100000:3.0:1788846182.501220:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1788846182.501231:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15567:x1875740683530624:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846182.501251:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846182.501270:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138273062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217549eb expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501331:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501345:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501356:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501394:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501402:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501702:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501747:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501754:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501762:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501768:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42da00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846182.501772:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501779:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501789:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e45176fa00) 00010000:00010000:3.0:1788846182.501793:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846182.501797:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501803:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d56138273069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501822:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501828:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501835:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501840:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ce00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846182.501843:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501849:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501856:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90e45176f400) 00010000:00010000:3.0:1788846182.501858:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846182.501861:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501866:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273070 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501895:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138273062 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549eb expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501906:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e45176fa00) 00010000:00010000:3.0:1788846182.501908:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846182.501918:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d56138273062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549eb expref: 10 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.501928:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d600, rc 0) 00000100:00100000:3.0:1788846182.501994:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15567:x1875740683530624:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 764us (1014us total) trans 0 rc 301/301 00000100:00100000:3.0:1788846182.502001:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:1.0:1788846182.515604:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.516116:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683530752 00000100:00100000:3.0:1788846182.516126:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683530752 00000100:00100000:3.0:1788846182.516177:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:3.0:1788846182.516187:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15567:x1875740683530752:12345-192.168.203.20@tcp:700:lfs.0 00000100:00100000:3.0:1788846182.516272:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15567:x1875740683530752:12345-192.168.203.20@tcp:700:lfs.0 Request processed in 87us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.516280:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:0.0:1788846182.523442:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.523564:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683531008 00000100:00100000:2.0:1788846182.523574:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683531008 00000100:00100000:2.0:1788846182.523717:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:2.0:1788846182.523726:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15567:x1875740683531008:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:2.0:1788846182.523775:0:17089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846182.523797:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357600/0x21b4d56138272f90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754958 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.523814:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e45176fa00) 00010000:00010000:2.0:1788846182.523818:0:17089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846182.523865:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.523878:0:17089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 5 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.523887:0:17089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.523926:0:17089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 5 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.523948:0:17089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 5 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846182.523962:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1875740702481408:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846182.524102:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e469a71840 going to sleep for 11 seconds 00000100:00100000:0.0:1788846182.528086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.528206:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1875740702481408:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846182.528233:0:17089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846182.528679:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683531136 00000100:00100000:3.0:1788846182.528686:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683531136 00010000:00010000:3.0:1788846182.528722:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 6 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846182.528795:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:3.0:1788846182.528805:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2399:x1875740683531136:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846182.528820:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846182.528827:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 6 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.528850:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 6 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.528891:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e441357e00/0x21b4d56138272fcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549c8 expref: 6 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.528905:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e45176fa00) 00010000:00010000:3.0:1788846182.528910:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.528919:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.528926:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.528965:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846182.529033:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2399:x1875740683531136:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 229us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.529041:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00010000:00010000:0.0:1788846182.529203:0:17089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.529211:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.529236:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.529247:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.529265:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.530740:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.530757:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.530766:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846182.530782:0:17089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1e67ac3 reply state 00000000b614f16b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.530793:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.530808:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:0.0:1788846182.530811:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846182.530815:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788846182.530820:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788846182.530833:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.531335:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.531347:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.531354:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaac00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846182.531358:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.531365:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.531376:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e45176fa00) 00010000:00010000:0.0:1788846182.531379:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846182.531382:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.531388:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273077 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846182.531409:0:17089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1e67ac3 reply state 00000000b614f16b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.531430:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846182.531438:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90e451663700) 00010000:00010000:0.0:1788846182.531440:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846182.531442:0:17089:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788846182.531551:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+10:15567:x1875740683531008:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 7822us (8114us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788846182.531560:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 28 00000100:00100000:0.0:1788846182.687053:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.687187:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683531264 00000100:00100000:2.0:1788846182.687198:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683531264 00000100:00100000:2.0:1788846182.687271:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1788846182.687281:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+10:15575:x1875740683531264:12345-192.168.203.20@tcp:101:lctl.0 00010000:00010000:2.0:1788846182.687304:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846182.687435:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827308c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217549f2 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.687497:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab000/0x21b4d56138273093 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.687511:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab000/0x21b4d56138273093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.687550:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab000/0x21b4d56138273093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846182.687700:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788846182.687704:0:17088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846182.687742:0:17088:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab000/0x21b4d56138273093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.687763:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827308c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549f2 expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.687799:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab000/0x21b4d56138273093 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549f2 expref: 11 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.687806:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:2.0:1788846182.687809:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846182.687812:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aab000, rc 0) 00000100:00100000:2.0:1788846182.687871:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+11:15575:x1875740683531264:12345-192.168.203.20@tcp:101:lctl.0 Request processed in 592us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846182.687877:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 29 00000100:00100000:2.0:1788846182.720720:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846182.721015:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683531392 00000100:00100000:1.0:1788846182.721025:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683531392 00000100:00100000:1.0:1788846182.721084:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1788846182.721095:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+5:15576:x1875740683531392:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846182.721113:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846182.721134:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827309a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc6217549f9 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.721215:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2600/0x21b4d561382730a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.721230:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2600/0x21b4d561382730a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.721243:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2600/0x21b4d561382730a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846182.721287:0:18618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788846182.721291:0:18618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846182.721312:0:18618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2600/0x21b4d561382730a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.721335:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d5613827309a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549f9 expref: 7 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.721352:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e2600/0x21b4d561382730a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc6217549f9 expref: 6 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.721361:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:1.0:1788846182.721364:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788846182.721367:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e2600, rc 0) 00000100:00100000:1.0:1788846182.721425:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15576:x1875740683531392:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 332us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846182.721432:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 30 00000100:00100000:1.0:1788846182.731044:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.731135:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683531520 00000100:00100000:3.0:1788846182.731145:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683531520 00000100:00100000:3.0:1788846182.731205:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:3.0:1788846182.731215:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+6:15576:x1875740683531520:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846182.731233:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846182.731251:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a00 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731330:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731363:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731385:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731397:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731405:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731413:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731485:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382730bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731493:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382730bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731500:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382730bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846182.731569:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788846182.731573:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846182.731595:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382730bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731607:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731622:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731629:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731635:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ce00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846182.731639:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731646:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731658:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:3.0:1788846182.731661:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846182.731665:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731670:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d561382730af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731682:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731689:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731694:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731699:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42da00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846182.731707:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731714:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731721:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90e451663700) 00010000:00010000:3.0:1788846182.731724:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846182.731726:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731731:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731756:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a00 expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731769:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382730bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a00 expref: 7 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.731776:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:3.0:1788846182.731778:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846182.731781:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:3.0:1788846182.731843:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+7:15576:x1875740683531520:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 629us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.731850:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 31 00000100:00100000:0.0:1788846182.735807:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.735965:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683531648 00000100:00100000:3.0:1788846182.735975:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683531648 00000100:00100000:3.0:1788846182.736032:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:3.0:1788846182.736043:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:15576:x1875740683531648:12345-192.168.203.20@tcp:900:lfs.0 00000100:00100000:3.0:1788846182.736145:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:15576:x1875740683531648:12345-192.168.203.20@tcp:900:lfs.0 Request processed in 104us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.736152:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:0.0:1788846182.740899:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.741000:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683531904 00000100:00100000:2.0:1788846182.741011:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683531904 00000100:00100000:2.0:1788846182.741073:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:2.0:1788846182.741083:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+7:15576:x1875740683531904:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846182.741104:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846182.741123:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382730c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a07 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846182.741219:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788846182.741629:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382730c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a07 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.741645:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:2.0:1788846182.741648:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846182.741653:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382730c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a07 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.741686:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa800, rc 0) 00000100:00100000:2.0:1788846182.741749:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+8:15576:x1875740683531904:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 667us (858us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788846182.741756:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 32 00000100:00100000:0.0:1788846182.744846:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.744946:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683532160 00000100:00100000:3.0:1788846182.744957:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683532160 00000100:00100000:3.0:1788846182.745009:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:3.0:1788846182.745019:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+8:15576:x1875740683532160:12345-192.168.203.20@tcp:36:lfs.0 00010000:00010000:3.0:1788846182.745070:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846182.745095:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382730bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a00 expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.745112:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:3.0:1788846182.745116:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846182.745135:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.745147:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.745156:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788846182.745346:0:17090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9202855 reply state 00000000c6c14eee transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.745359:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.745366:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:3.0:1788846182.745499:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788846182.745502:0:17090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788846182.745509:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788846182.745616:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+9:15576:x1875740683532160:12345-192.168.203.20@tcp:36:lfs.0 Request processed in 597us (778us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788846182.745623:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 33 00000100:00100000:0.0:1788846182.751273:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.751508:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683532416 00000100:00100000:2.0:1788846182.751554:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683532416 00000100:00100000:2.0:1788846182.751602:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1788846182.751611:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+9:15576:x1875740683532416:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846182.751865:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+10:15576:x1875740683532416:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 254us (600us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788846182.751873:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1788846182.758084:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846182.758182:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683532672 00000100:00100000:1.0:1788846182.758204:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683532672 00000100:00100000:1.0:1788846182.758321:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:1.0:1788846182.758333:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+10:15576:x1875740683532672:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:1.0:1788846182.758358:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846182.758387:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382730d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a0e expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758459:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758473:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758483:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758494:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758511:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758517:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846182.758675:0:18618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788846182.758745:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758753:0:18618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758771:0:18618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758777:0:18618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3e00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846182.758782:0:18618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758789:0:18618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758802:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:1.0:1788846182.758805:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846182.758809:0:18618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.758816:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d561382730e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759207:0:18618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759214:0:18618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759219:0:18618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759224:0:18618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e47d1e3c00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846182.759227:0:18618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759243:0:18618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759252:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90e451663700) 00010000:00010000:1.0:1788846182.759255:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788846182.759258:0:18618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759264:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d561382730e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759300:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382730d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a0e expref: 12 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759311:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:1.0:1788846182.759313:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788846182.759316:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3200/0x21b4d561382730d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a0e expref: 12 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.759325:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3200, rc 0) 00000100:00100000:1.0:1788846182.759381:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+11:15576:x1875740683532672:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1050us (1304us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788846182.759389:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 34 00000100:00100000:1.0:1788846182.766443:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.766749:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683532800 00000100:00100000:3.0:1788846182.766760:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683532800 00000100:00100000:3.0:1788846182.766831:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:3.0:1788846182.766842:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+11:15576:x1875740683532800:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:3.0:1788846182.766864:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846182.766896:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382730f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a15 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.767004:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.767018:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.767030:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846182.767055:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788846182.767060:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788846182.767077:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.767102:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382730f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.767138:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.767147:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:3.0:1788846182.767149:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788846182.767153:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42da00, rc 0) 00000100:00100000:3.0:1788846182.767202:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e9c95b52-bf21-4a43-abed-5b176d36d076+12:15576:x1875740683532800:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 363us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.767209:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 35 00000100:00100000:0.0:1788846182.774777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.774855:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683532928 00000100:00100000:2.0:1788846182.774865:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683532928 00000100:00100000:2.0:1788846182.774952:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1788846182.774963:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+12:15576:x1875740683532928:12345-192.168.203.20@tcp:37:lfs.0 00000100:00100000:2.0:1788846182.784186:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+12:15576:x1875740683532928:12345-192.168.203.20@tcp:37:lfs.0 Request processed in 9006us (9200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846182.784199:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:1.0:1788846182.792237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846182.792402:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683533184 00000100:00100000:0.0:1788846182.792413:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683533184 00000100:00100000:0.0:1788846182.792471:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1788846182.792481:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f405850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+12:15576:x1875740683533184:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1788846182.792884:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f405850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+13:15576:x1875740683533184:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 403us (653us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788846182.792892:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 4 00000100:00100000:0.0:1788846182.862179:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.862295:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683533312 00000100:00100000:2.0:1788846182.862305:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683533312 00000100:00100000:2.0:1788846182.862480:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:2.0:1788846182.862493:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+11:15582:x1875740683533312:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846182.862515:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846182.862574:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a1c expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862654:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862669:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862680:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862693:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862701:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862707:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862789:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273118 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862798:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862805:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846182.862858:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788846182.862863:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846182.862915:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273118 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862951:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862957:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862964:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862970:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846182.862974:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862982:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.862996:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:2.0:1788846182.862999:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846182.863003:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863009:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d5613827310a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863023:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863030:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863035:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863048:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaac00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846182.863051:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863058:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863067:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90e451663700) 00010000:00010000:2.0:1788846182.863070:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846182.863072:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863078:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273111 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863107:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a1c expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863120:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aabc00/0x21b4d56138273118 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a1c expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.863127:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:2.0:1788846182.863130:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788846182.863132:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aabc00, rc 0) 00000100:00100000:2.0:1788846182.863191:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+12:15582:x1875740683533312:12345-192.168.203.20@tcp:101:bash.0 Request processed in 701us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846182.863199:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 36 00000100:00100000:1.0:1788846182.868151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.868230:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683533440 00000100:00100000:3.0:1788846182.868241:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683533440 00000100:00100000:3.0:1788846182.868302:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:3.0:1788846182.868313:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:15582:x1875740683533440:12345-192.168.203.20@tcp:900:bash.0 00000100:00100000:3.0:1788846182.868411:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:15582:x1875740683533440:12345-192.168.203.20@tcp:900:bash.0 Request processed in 93us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846182.868418:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:0.0:1788846182.871301:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.871388:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683533696 00000100:00100000:3.0:1788846182.871398:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683533696 00000100:00100000:3.0:1788846182.871463:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:3.0:1788846182.871473:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+12:15582:x1875740683533696:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846182.871491:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846182.871513:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827311f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a23 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.871685:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.871712:0:17090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.871722:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.871757:0:17090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 12 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.871771:0:17090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 12 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846182.871785:0:17090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e3439e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17090:1875740702481536:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846182.871857:0:17090:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e343807300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846182.875318:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846182.875566:0:17090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e3439e5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17090:1875740702481536:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846182.875593:0:17090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846182.875667:0:20117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683533824 00000100:00100000:2.0:1788846182.875680:0:20117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683533824 00010000:00010000:2.0:1788846182.875713:0:20117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 13 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846182.875752:0:20117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:2.0:1788846182.875761:0:20117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+13:2399:x1875740683533824:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846182.875774:0:20117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846182.875781:0:20117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 13 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.875791:0:20117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 13 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.875812:0:20117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42da00/0x21b4d561382730fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a15 expref: 13 pid: 17090 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.875827:0:20117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:2.0:1788846182.875832:0:20117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.876029:0:20117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.876037:0:20117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846182.876068:0:20117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788846182.876182:0:17090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876189:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876211:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876221:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876235:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876748:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876759:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876766:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846182.876776:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788846182.876801:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876809:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876816:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.876822:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ce00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846182.876826:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.877098:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.877110:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:3.0:1788846182.877113:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846182.877126:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.877133:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d56138273126 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788846182.877146:0:17090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abcc15da reply state 00000000275ed2fe transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.877158:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.877165:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90e45176f400) 00010000:00010000:3.0:1788846182.877168:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788846182.877170:0:17090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788846182.877209:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d5613827311f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 15 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.877223:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 14 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846182.877230:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846182.877232:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788846182.877234:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42d200, rc 0) 00000100:00100000:2.0:1788846182.877422:0:20117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9c95b52-bf21-4a43-abed-5b176d36d076+12:2399:x1875740683533824:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 1660us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846182.877440:0:20117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 16 00000100:00100000:3.0:1788846182.878327:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+15:15582:x1875740683533696:12345-192.168.203.20@tcp:101:bash.0 Request processed in 6849us (7028us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788846182.878336:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 37 00000100:00100000:0.0:1788846182.903800:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846182.903950:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683533952 00000100:00100000:1.0:1788846182.903962:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683533952 00000100:00100000:1.0:1788846182.904029:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:1.0:1788846182.904039:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+15:15582:x1875740683533952:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:1.0:1788846182.904062:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788846182.904083:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273142 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a2a expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.904154:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138273149 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.904170:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138273149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.904181:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138273149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788846182.904231:0:18618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788846182.904235:0:18618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788846182.904261:0:18618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138273149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.904272:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138273149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.904296:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3e00/0x21b4d56138273142 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a2a expref: 17 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.904313:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138273149 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a2a expref: 16 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846182.904322:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:1.0:1788846182.904331:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788846182.904334:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e47d1e3c00, rc 0) 00000100:00100000:1.0:1788846182.904419:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+16:15582:x1875740683533952:12345-192.168.203.20@tcp:101:bash.0 Request processed in 381us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846182.904425:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 38 00000100:00100000:0.0:1788846182.912872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846182.912977:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683534208 00000100:00100000:2.0:1788846182.912987:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683534208 00000100:00100000:2.0:1788846182.913044:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:2.0:1788846182.913063:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+16:15582:x1875740683534208:12345-192.168.203.20@tcp:35:bash.0 00000100:00100000:2.0:1788846182.913342:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+17:15582:x1875740683534208:12345-192.168.203.20@tcp:35:bash.0 Request processed in 288us (476us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788846182.913350:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 5 00000100:00100000:3.0:1788846183.038120:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.038222:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683534464 00000100:00100000:2.0:1788846183.038232:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683534464 00000100:00100000:2.0:1788846183.038290:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:2.0:1788846183.038300:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+17:15592:x1875740683534464:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846183.038336:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846183.038356:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a31 expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846183.038457:0:17088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788846183.038589:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273150 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a31 expref: 19 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.038603:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:2.0:1788846183.038606:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846183.038611:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a31 expref: 19 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.038625:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa800, rc 0) 00000100:00100000:2.0:1788846183.038685:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+18:15592:x1875740683534464:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 386us (575us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788846183.038692:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 39 00000100:00100000:1.0:1788846183.045239:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.045315:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683534720 00000100:00100000:2.0:1788846183.045334:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683534720 00000100:00100000:2.0:1788846183.045389:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 6 00000100:00100000:2.0:1788846183.045407:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+18:15592:x1875740683534720:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846183.045644:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+19:15592:x1875740683534720:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 238us (413us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788846183.045651:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 6 00010000:00010000:3.0:1788846183.098627:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788846183.112811:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.112910:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683534976 00000100:00100000:2.0:1788846183.112921:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683534976 00000100:00100000:2.0:1788846183.112990:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:2.0:1788846183.113001:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+19:15595:x1875740683534976:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846183.113022:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846183.113041:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827315e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a38 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.113144:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273165 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.113158:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.113171:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846183.113182:0:18618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788846183.113296:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d5613827315e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a38 expref: 22 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.113327:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273165 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a38 expref: 21 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.113336:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.113339:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846183.113343:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaac00, rc 0) 00000100:00100000:2.0:1788846183.113412:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+21:15595:x1875740683534976:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 413us (609us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788846183.113419:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 40 00000100:00100000:3.0:1788846183.116404:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.116822:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683535104 00000100:00100000:2.0:1788846183.116832:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683535104 00000100:00100000:2.0:1788846183.116889:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:2.0:1788846183.116900:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+21:15595:x1875740683535104:12345-192.168.203.20@tcp:54:lfs.0 00010000:00010000:2.0:1788846183.116971:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.116988:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.116998:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.117038:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.117045:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.117161:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.117169:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846183.117173:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.117181:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.117193:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.117196:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846183.117201:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.117208:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273173 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846183.117295:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+21:15595:x1875740683535104:12345-192.168.203.20@tcp:54:lfs.0 Request processed in 396us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846183.117303:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 41 00000100:00100000:1.0:1788846183.117389:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.117934:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683535232 00000100:00100000:2.0:1788846183.117941:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683535232 00000100:00100000:2.0:1788846183.117988:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:2.0:1788846183.117996:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342580700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+21:2400:x1875740683535232:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846183.118007:0:17075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846183.118023:0:17075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273165 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a38 expref: 21 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.118049:0:17075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.118053:0:17075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846183.118096:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342580700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+20:2400:x1875740683535232:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 100us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846183.118103:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 0 00000100:00100000:1.0:1788846183.126773:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.126893:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683535488 00000100:00100000:2.0:1788846183.126911:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683535488 00000100:00100000:2.0:1788846183.126976:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 7 00000100:00100000:2.0:1788846183.126995:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+20:15595:x1875740683535488:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846183.127203:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+21:15595:x1875740683535488:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 217us (438us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788846183.127211:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 7 00000040:00080000:2.0:1788846183.162175:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788846183.431224:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.431294:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683535744 00000100:00100000:2.0:1788846183.431304:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683535744 00000100:00100000:2.0:1788846183.431365:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:2.0:1788846183.431375:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+21:15626:x1875740683535744:12345-192.168.203.20@tcp:101:cat.0 00010000:00010000:2.0:1788846183.431397:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846183.431417:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d5613827317a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a3f expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.433019:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273181 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.433034:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.433060:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846183.433073:0:18618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788846183.433197:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d5613827317a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a3f expref: 24 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.433218:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a3f expref: 23 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.433226:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.433229:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846183.433232:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa200, rc 0) 00000100:00100000:2.0:1788846183.433636:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+23:15626:x1875740683535744:12345-192.168.203.20@tcp:101:cat.0 Request processed in 2253us (2410us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788846183.433645:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 42 00000100:00100000:1.0:1788846183.440513:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.440892:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683535872 00000100:00100000:2.0:1788846183.440902:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683535872 00000100:00100000:2.0:1788846183.440974:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:2.0:1788846183.440985:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342582a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+23:2398:x1875740683535872:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846183.440999:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846183.441024:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273181 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a3f expref: 23 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.441044:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.441048:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846183.441115:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342582a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+22:2398:x1875740683535872:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 132us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846183.441123:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 1 00000100:00100000:1.0:1788846183.441279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.441340:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683536128 00000100:00100000:2.0:1788846183.441345:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683536128 00000100:00100000:2.0:1788846183.441421:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:2.0:1788846183.441441:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+22:15626:x1875740683536128:12345-192.168.203.20@tcp:35:cat.0 00000100:00100000:2.0:1788846183.442091:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+23:15626:x1875740683536128:12345-192.168.203.20@tcp:35:cat.0 Request processed in 659us (809us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788846183.442098:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 8 00000100:00100000:1.0:1788846183.548296:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846183.548485:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683536384 00000100:00100000:3.0:1788846183.548496:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683536384 00000100:00100000:3.0:1788846183.548589:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:3.0:1788846183.548600:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+23:15632:x1875740683536384:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:3.0:1788846183.548620:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846183.548650:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827318f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a46 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846183.549214:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138273196 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846183.549230:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138273196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846183.549241:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138273196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846183.549252:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788846183.549373:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827318f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a46 expref: 26 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846183.549595:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138273196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a46 expref: 25 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846183.549606:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846183.549609:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788846183.549612:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:3.0:1788846183.549687:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+25:15632:x1875740683536384:12345-192.168.203.20@tcp:101:dd.0 Request processed in 1089us (1399us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788846183.549713:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 43 00000100:00100000:3.0:1788846183.555152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846183.555189:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.555552:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683536640 00000100:00100000:2.0:1788846183.555561:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683536640 00000100:00100000:2.0:1788846183.555621:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:2.0:1788846183.555640:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+25:2400:x1875740683536640:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846183.555656:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846183.555677:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d56138273196 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a46 expref: 25 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.555696:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.555700:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846183.555753:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+24:2400:x1875740683536640:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 124us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846183.555759:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 2 00000100:00100000:0.0:1788846183.556328:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683536512 00000100:00100000:0.0:1788846183.556334:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683536512 00000100:00100000:0.0:1788846183.556370:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:0.0:1788846183.556377:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+24:15632:x1875740683536512:12345-192.168.203.20@tcp:101:dd.0 00010000:00010000:0.0:1788846183.556396:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846183.556409:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382731a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a4d expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.556437:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.556450:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.556460:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.556600:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382731a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 26 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.556616:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 25 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.556623:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846183.556626:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846183.556645:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0da00, rc 0) 00000100:00100000:0.0:1788846183.556853:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e3439e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+25:15632:x1875740683536512:12345-192.168.203.20@tcp:101:dd.0 Request processed in 474us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846183.556860:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 44 00000100:00100000:3.0:1788846183.565109:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.565296:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683536896 00000100:00100000:2.0:1788846183.565306:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683536896 00000100:00100000:2.0:1788846183.565370:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 45 00000100:00100000:2.0:1788846183.565381:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+25:15632:x1875740683536896:12345-192.168.203.20@tcp:36:dd.0 00010000:00010000:2.0:1788846183.565438:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846183.565464:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e47d1e3c00/0x21b4d56138273149 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a2a expref: 25 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.565481:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.565485:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846183.565852:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.565866:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.565878:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846183.565920:0:17088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788846183.565954:0:17088:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087f86dba reply state 00000000ae93be26 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.565967:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.565974:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.565976:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846183.565978:0:17088:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846183.566070:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+27:15632:x1875740683536896:12345-192.168.203.20@tcp:36:dd.0 Request processed in 690us (967us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788846183.566077:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 45 00000020:00080000:2.0:1788846183.566082:0:17088:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788846183.694829:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846183.695033:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683537152 00000100:00100000:0.0:1788846183.695043:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683537152 00000100:00100000:0.0:1788846183.695100:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:0.0:1788846183.695110:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+27:15632:x1875740683537152:12345-192.168.203.20@tcp:35:dd.0 00000100:00100000:0.0:1788846183.695333:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+28:15632:x1875740683537152:12345-192.168.203.20@tcp:35:dd.0 Request processed in 223us (513us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1788846183.695342:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 9 00000100:00100000:1.0:1788846183.872991:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846183.873068:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683537280 00000100:00100000:0.0:1788846183.873077:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683537280 00000100:00100000:0.0:1788846183.873131:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:0.0:1788846183.873140:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+28:15646:x1875740683537280:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:0.0:1788846183.873163:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846183.873182:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382731b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a54 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873255:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873269:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873280:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873291:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873310:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873317:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873384:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d561382731ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873393:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d561382731ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873400:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d561382731ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846183.873436:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788846183.873440:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846183.873473:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d561382731ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873483:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d561382731ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873492:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873498:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873504:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873545:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846183.873550:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873558:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873569:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:0.0:1788846183.873572:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846183.873576:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873582:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873596:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873601:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873607:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873612:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0cc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846183.873615:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873621:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873770:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90e45176f400) 00010000:00010000:0.0:1788846183.873772:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846183.873776:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873782:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873807:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382731b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a54 expref: 30 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873819:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d561382731ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a54 expref: 29 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846183.873826:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846183.873828:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846183.873831:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0c400, rc 0) 00000100:00100000:0.0:1788846183.873882:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+29:15646:x1875740683537280:12345-192.168.203.20@tcp:101:stat.0 Request processed in 743us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846183.873889:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 46 00000100:00100000:3.0:1788846183.941768:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846183.942494:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683537536 00000100:00100000:2.0:1788846183.942517:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683537536 00000100:00100000:2.0:1788846183.942664:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 47 00000100:00100000:2.0:1788846183.942675:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+29:15652:x1875740683537536:12345-192.168.203.20@tcp:36:truncate.0 00010000:00010000:2.0:1788846183.942725:0:17090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846183.942751:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c400/0x21b4d561382731ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a54 expref: 29 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.942770:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.942776:0:17090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846183.943495:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.943512:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.943567:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846183.943740:0:17090:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788846183.943764:0:17090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4b3e632 reply state 000000004e2d2caa transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.943776:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846183.943784:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846183.943786:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788846183.943789:0:17090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788846183.944075:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+31:15652:x1875740683537536:12345-192.168.203.20@tcp:36:truncate.0 Request processed in 1399us (2314us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788846183.944083:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 47 00000020:00080000:2.0:1788846183.944098:0:17090:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788846184.107092:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.107193:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683537664 00000100:00100000:0.0:1788846184.107207:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683537664 00000100:00100000:0.0:1788846184.107307:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00100000:0.0:1788846184.107321:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+31:15666:x1875740683537664:12345-192.168.203.20@tcp:101:stat.0 00010000:00010000:0.0:1788846184.107345:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846184.107364:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382731dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a5b expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107470:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107486:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107499:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107510:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107562:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107571:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107647:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107656:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107663:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788846184.107944:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788846184.107949:0:17089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788846184.107969:0:17089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.107992:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108001:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108007:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108013:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108019:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0cc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.108024:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108031:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108042:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:0.0:1788846184.108045:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.108050:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108057:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382731e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108071:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108077:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108090:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108096:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.108099:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108105:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108114:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90e45176f400) 00010000:00010000:0.0:1788846184.108116:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.108119:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108125:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d800/0x21b4d561382731ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108156:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382731dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 33 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108170:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 32 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.108177:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846184.108180:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846184.108182:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0d400, rc 0) 00000100:00100000:0.0:1788846184.108246:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+32:15666:x1875740683537664:12345-192.168.203.20@tcp:101:stat.0 Request processed in 928us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846184.108265:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 48 00000100:00080000:3.0:1788846184.108975:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788846184.121997:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846184.232915:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.233041:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683537920 00000100:00100000:2.0:1788846184.233051:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683537920 00000100:00100000:2.0:1788846184.233111:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:2.0:1788846184.233120:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+32:15675:x1875740683537920:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846184.233139:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.233157:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382731f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a62 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846184.233261:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788846184.233349:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382731f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a62 expref: 34 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.233364:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:2.0:1788846184.233366:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846184.233371:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382731f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a62 expref: 34 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.233396:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa800, rc 0) 00000100:00100000:2.0:1788846184.233457:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+33:15675:x1875740683537920:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 338us (551us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788846184.233464:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 49 00000100:00100000:1.0:1788846184.238497:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.238668:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683538176 00000100:00100000:0.0:1788846184.238681:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683538176 00000100:00100000:0.0:1788846184.238752:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:0.0:1788846184.238764:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47f405450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+33:15675:x1875740683538176:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:0.0:1788846184.239094:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47f405450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+34:15675:x1875740683538176:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 332us (610us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788846184.239103:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 10 00000100:00100000:0.0:1788846184.321993:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.322119:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683538432 00000100:00100000:2.0:1788846184.322135:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683538432 00000100:00100000:2.0:1788846184.322215:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:2.0:1788846184.322225:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+34:15682:x1875740683538432:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846184.322246:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.322277:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273206 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a69 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.322377:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.322391:0:18618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 35 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.322400:0:18618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.322408:0:18618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.322441:0:18618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 35 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.322455:0:18618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 35 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.322467:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18618:1875740702481664:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846184.322615:0:18618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 35 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.322625:0:18618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 35 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.322635:0:18618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18618:1875740702481792:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846184.322666:0:18618:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e3429686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846184.330604:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18618:1875740702481664:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846184.330625:0:18618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18618:1875740702481792:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846184.330653:0:18618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846184.331471:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.331562:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.331669:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683538560 00000100:00100000:2.0:1788846184.331680:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683538560 00010000:00010000:2.0:1788846184.331730:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 36 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.331858:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683538688 00000100:00100000:2.0:1788846184.331862:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683538688 00010000:00010000:2.0:1788846184.331879:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 37 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846184.332011:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1788846184.332027:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f27d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:2398:x1875740683538560:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846184.332044:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846184.332053:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 37 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332067:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 37 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332095:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d400/0x21b4d561382731f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a5b expref: 37 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332115:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846184.332121:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332132:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332162:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846184.332249:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f27d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+36:2398:x1875740683538560:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 226us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846184.332257:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 17 00000100:00100000:3.0:1788846184.332311:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 18 00000100:00100000:3.0:1788846184.332319:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+35:2398:x1875740683538688:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846184.332327:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846184.332332:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 35 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332341:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 35 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332366:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273134 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a23 expref: 35 pid: 17090 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332376:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846184.332380:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332388:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332396:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332426:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846184.332451:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+34:2398:x1875740683538688:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 133us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846184.332459:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 18 00010000:00010000:3.0:1788846184.332502:0:18618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332511:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788846184.332579:0:18618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788846184.332742:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d56138273206 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 35 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332760:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 34 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.332767:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846184.332770:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788846184.332772:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaba00, rc 0) 00000100:00100000:3.0:1788846184.332799:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+34:15682:x1875740683538432:12345-192.168.203.20@tcp:101:bash.0 Request processed in 10576us (10821us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788846184.332806:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 50 00000100:00100000:1.0:1788846184.335607:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.335783:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683538944 00000100:00100000:3.0:1788846184.335796:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683538944 00000100:00100000:3.0:1788846184.335864:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 51 00000100:00100000:3.0:1788846184.335875:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+34:15682:x1875740683538944:12345-192.168.203.20@tcp:36:bash.0 00010000:00010000:3.0:1788846184.336199:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.336245:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.336260:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788846184.336315:0:17090:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788846184.336340:0:17090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000995779d6 reply state 00000000c361f92e transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.336355:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.336363:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846184.336366:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788846184.336371:0:17090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788846184.336496:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:15682:x1875740683538944:12345-192.168.203.20@tcp:36:bash.0 Request processed in 622us (901us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788846184.336504:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 51 00000020:00080000:3.0:1788846184.336510:0:17090:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788846184.339578:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.339667:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683539072 00000100:00100000:2.0:1788846184.339680:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683539072 00000100:00100000:2.0:1788846184.339765:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:2.0:1788846184.339777:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:15682:x1875740683539072:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846184.339818:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.339844:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273222 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a70 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.339927:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273222 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a70 expref: 38 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.339946:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273222 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a70 expref: 38 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.339991:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846184.339994:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846184.339999:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aab400, rc 0) 00000100:00100000:2.0:1788846184.340076:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+38:15682:x1875740683539072:12345-192.168.203.20@tcp:101:bash.0 Request processed in 300us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.340082:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 52 00000100:00100000:1.0:1788846184.345726:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.345824:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683539200 00000100:00100000:3.0:1788846184.345837:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683539200 00000100:00100000:3.0:1788846184.345935:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:3.0:1788846184.345947:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+38:15682:x1875740683539200:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:3.0:1788846184.345974:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846184.346001:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273229 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a77 expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.346152:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.346178:0:17090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 39 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.346189:0:17090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.346235:0:17090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 39 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.346252:0:17090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 39 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846184.346269:0:17090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17090:1875740702481920:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846184.346377:0:17090:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e343807240 going to sleep for 11 seconds 00000100:00100000:3.0:1788846184.351238:0:17090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17090:1875740702481920:192.168.203.20@tcp:104: 00010000:00010000:3.0:1788846184.351302:0:17090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846184.352205:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.352837:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683539328 00000100:00100000:3.0:1788846184.352996:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683539328 00010000:00010000:3.0:1788846184.353050:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 40 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846184.353140:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:3.0:1788846184.353152:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342580700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+40:2398:x1875740683539328:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846184.353178:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846184.353195:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 40 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.353209:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 40 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.353238:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827320d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a69 expref: 40 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.353258:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846184.353263:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.353275:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.353284:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.353329:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788846184.353508:0:17090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.353517:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846184.353628:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788846184.353634:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846184.353659:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.353697:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d56138273229 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a77 expref: 40 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.353715:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a77 expref: 39 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.353735:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846184.353738:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788846184.353741:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42c200, rc 0) 00000100:00100000:3.0:1788846184.353823:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342580700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+39:2398:x1875740683539328:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 672us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846184.353832:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 19 00000100:00100000:2.0:1788846184.354614:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+38:15682:x1875740683539200:12345-192.168.203.20@tcp:101:bash.0 Request processed in 8663us (8896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.354640:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 53 00000100:00100000:1.0:1788846184.357851:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.358092:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683539584 00000100:00100000:2.0:1788846184.358114:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683539584 00000100:00100000:2.0:1788846184.358673:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:2.0:1788846184.358686:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342582a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+38:15682:x1875740683539584:12345-192.168.203.20@tcp:103:bash.0 00010000:00010000:2.0:1788846184.358706:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788846184.358738:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273222 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a70 expref: 38 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.358767:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d56138273230 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a77 expref: 37 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.358779:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846184.358785:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846184.358849:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342582a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+36:15682:x1875740683539584:12345-192.168.203.20@tcp:103:bash.0 Request processed in 166us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.358858:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 3 00000100:00100000:0.0:1788846184.362711:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.362794:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683539712 00000100:00100000:3.0:1788846184.362807:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683539712 00000100:00100000:3.0:1788846184.362882:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:3.0:1788846184.362905:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46d4daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+36:15682:x1875740683539712:12345-192.168.203.20@tcp:58:bash.0 00010000:00010000:3.0:1788846184.363066:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.363270:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.363286:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846184.365939:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788846184.367714:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788846184.367997:0:18618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788846184.368139:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46d4daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+36:15682:x1875740683539712:12345-192.168.203.20@tcp:58:bash.0 Request processed in 5240us (5431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846184.368153:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 54 00000100:00100000:1.0:1788846184.372061:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.372152:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683539840 00000100:00100000:0.0:1788846184.372166:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683539840 00000100:00100000:0.0:1788846184.372276:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 55 00000100:00100000:0.0:1788846184.372289:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+36:15682:x1875740683539840:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:0.0:1788846184.372317:0:17088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846184.372355:0:17088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a7e expref: -99 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.372428:0:17088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.372440:0:17088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 37 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.372487:0:17088:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.372503:0:17088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 37 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.372540:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846184.372544:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846184.372548:0:17088:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 37 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.372557:0:17088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0de00, rc 0) 00000100:00100000:0.0:1788846184.372632:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:15682:x1875740683539840:12345-192.168.203.20@tcp:101:bash.0 Request processed in 346us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846184.372640:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 55 00000040:00080000:3.0:1788846184.506645:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788846184.506657:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788846184.506693:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788846184.506705:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788846184.507213:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17124:1875740702482048:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788846184.510769:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e343807480 going to sleep for 11 seconds 00000100:00100000:1.0:1788846184.519139:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.519313:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474665500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17124:1875740702482048:192.168.203.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788846184.519873:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683539968 00000100:00100000:2.0:1788846184.519884:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683539968 00000100:00100000:2.0:1788846184.519974:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:2.0:1788846184.519985:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:15683:x1875740683539968:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788846184.520026:0:17089:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788846184.520173:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:15683:x1875740683539968:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 189us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.520181:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 56 00000100:00100000:0.0:1788846184.524323:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.524730:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683540096 00000100:00100000:2.0:1788846184.524743:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683540096 00000100:00100000:2.0:1788846184.524821:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:2.0:1788846184.524832:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:15683:x1875740683540096:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788846184.525091:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.525114:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.525141:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531081:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531105:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531120:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531152:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531162:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531169:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846184.531217:0:17090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788846184.531232:0:17090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846184.531862:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531877:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531883:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531891:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531897:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846184.531901:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531908:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531929:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e45176f700) 00010000:00010000:2.0:1788846184.531932:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846184.531936:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531943:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d56138273245 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531959:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531965:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531985:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.531991:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaaa00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846184.531994:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532001:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532009:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff90e46d443200) 00010000:00010000:2.0:1788846184.532012:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846184.532015:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532021:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d5613827324c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532039:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532046:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532051:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532056:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaba00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846184.532058:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532072:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532080:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846184.532082:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846184.532084:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.532090:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273253 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.532183:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:15683:x1875740683540096:12345-192.168.203.20@tcp:34:lhsmtool_posix.0 Request processed in 7348us (7870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.532192:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 57 00000100:00100000:1.0:1788846184.541445:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.545136:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683540352 00000100:00100000:2.0:1788846184.545160:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683540352 00000100:00100000:2.0:1788846184.545408:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:2.0:1788846184.545424:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+37:15683:x1875740683540352:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846184.545452:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.545481:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827325a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a85 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545658:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545679:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545693:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846184.545725:0:17089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788846184.545831:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545839:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545847:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545854:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaaa00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846184.545859:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545880:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545896:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846184.545899:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788846184.545904:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545910:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273261 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545976:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827325a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a85 expref: 39 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.545988:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90e45176f700) 00010000:00010000:2.0:1788846184.545990:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846184.546002:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d5613827325a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a85 expref: 39 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.546015:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaba00, rc 0) 00000100:00100000:2.0:1788846184.546099:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+38:15683:x1875740683540352:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 679us (4668us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788846184.546106:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 58 00000100:00100000:1.0:1788846184.553802:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.553972:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683540480 00000100:00100000:0.0:1788846184.553992:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683540480 00000100:00100000:0.0:1788846184.554074:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1788846184.554086:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+38:15683:x1875740683540480:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788846184.554130:0:17088:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788846184.554308:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+38:15683:x1875740683540480:12345-192.168.203.20@tcp:53:lhsmtool_posix.0 Request processed in 223us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846184.554316:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 59 00000100:00100000:0.0:1788846184.566579:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.566953:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683540736 00000100:00100000:3.0:1788846184.566967:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683540736 00000100:00100000:3.0:1788846184.567110:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:3.0:1788846184.567122:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+38:15683:x1875740683540736:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846184.567149:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846184.567177:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d5613827326f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a8c expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788846184.569405:0:18618:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1788846184.569424:0:18618:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788846184.569455:0:18618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788846184.569754:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c600/0x21b4d56138273276 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.569775:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c600/0x21b4d56138273276 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.569790:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c600/0x21b4d56138273276 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.569884:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c200/0x21b4d5613827326f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a8c expref: 41 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.569909:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c600/0x21b4d56138273276 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a8c expref: 40 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.569930:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663900) 00010000:00010000:0.0:1788846184.569933:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788846184.569937:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0c600, rc 0) 00000100:00100000:0.0:1788846184.570215:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+40:15683:x1875740683540736:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 3092us (3697us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788846184.570225:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 60 00000100:00100000:1.0:1788846184.580759:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.580843:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683540992 00000100:00100000:0.0:1788846184.580858:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683540992 00000100:00100000:0.0:1788846184.580953:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:0.0:1788846184.580966:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+40:15683:x1875740683540992:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788846184.581059:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846184.581115:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c600/0x21b4d56138273276 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a8c expref: 40 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.581140:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663900) 00010000:00010000:0.0:1788846184.581155:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846184.581182:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.581200:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.581212:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583443:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583468:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583481:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583555:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583563:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583569:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583576:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.583594:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583602:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583615:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:0.0:1788846184.583618:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.583623:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583630:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d600/0x21b4d56138273284 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583647:0:17088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583653:0:17088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583659:0:17088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583664:0:17088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.583667:0:17088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583673:0:17088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583681:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xed83f856 (ffff90e451663300) 00010000:00010000:0.0:1788846184.583684:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.583693:0:17088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.583700:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c800/0x21b4d5613827328b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xed83f856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846184.583818:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+39:15683:x1875740683540992:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 2850us (3072us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788846184.583827:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 61 00000100:00100000:2.0:1788846184.589284:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.589772:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683541120 00000100:00100000:0.0:1788846184.589789:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683541120 00000100:00100000:0.0:1788846184.590182:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:0.0:1788846184.590198:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+39:15683:x1875740683541120:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788846184.590235:0:17089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788846184.590266:0:17089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d200/0x21b4d56138273292 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a93 expref: -99 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.590313:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ce00/0x21b4d56138273299 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.590465:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ce00/0x21b4d56138273299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.590480:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ce00/0x21b4d56138273299 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.590667:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d200/0x21b4d56138273292 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a93 expref: 41 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.590693:0:17089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ce00/0x21b4d56138273299 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a93 expref: 40 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.590713:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:0.0:1788846184.590716:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788846184.590720:0:17089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342a0ce00, rc 0) 00000100:00100000:0.0:1788846184.590824:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+40:15683:x1875740683541120:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 629us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846184.590833:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 62 00000100:00100000:2.0:1788846184.597586:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.597690:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683541376 00000100:00100000:3.0:1788846184.597704:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683541376 00000100:00100000:3.0:1788846184.597806:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:3.0:1788846184.597819:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+40:15683:x1875740683541376:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788846184.597948:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.597970:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.597984:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788846184.598206:0:17090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788846184.598217:0:17090:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 568635695897ns, next at 569635693212ns, rc = 0 00000004:00010000:3.0:1788846184.598278:0:17090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfb93dd reply state 0000000046083e29 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.598293:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.598301:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:3.0:1788846184.598304:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788846184.598307:0:17090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788846184.602574:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+42:15683:x1875740683541376:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 4738us (5044us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1788846184.602591:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 63 00000100:00100000:1.0:1788846184.611369:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.611555:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683541504 00000100:00100000:2.0:1788846184.611569:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683541504 00000100:00100000:2.0:1788846184.611649:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1788846184.611661:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e342580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+42:15683:x1875740683541504:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846184.611693:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.611720:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754a9a expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.611794:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 43 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.611812:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 43 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.611835:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:2.0:1788846184.611838:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788846184.611843:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa800, rc 0) 00000100:00100000:2.0:1788846184.611945:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e342580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+43:15683:x1875740683541504:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 286us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.611974:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 64 00000100:00100000:2.0:1788846184.617170:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.617288:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683541632 00000100:00100000:3.0:1788846184.617317:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683541632 00000100:00100000:3.0:1788846184.617423:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:3.0:1788846184.617437:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2399:x1875740683541632:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788846184.617806:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2399:x1875740683541632:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 371us (649us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788846184.617815:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00080000:0.0:1788846184.618183:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788846184.621678:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.621799:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683541888 00000100:00100000:0.0:1788846184.621813:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683541888 00000100:00100000:0.0:1788846184.621886:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:0.0:1788846184.621906:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+43:15683:x1875740683541888:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788846184.622202:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+44:15683:x1875740683541888:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 297us (536us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788846184.622211:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 11 00000100:00100000:2.0:1788846184.626150:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.626649:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683542144 00000100:00100000:0.0:1788846184.626665:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683542144 00000100:00100000:0.0:1788846184.626747:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:0.0:1788846184.626759:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+44:15683:x1875740683542144:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788846184.626936:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+44:15683:x1875740683542144:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 179us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846184.626948:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 65 00000100:00100000:1.0:1788846184.629744:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.633224:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683542272 00000100:00100000:2.0:1788846184.633244:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683542272 00000100:00100000:2.0:1788846184.633341:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:2.0:1788846184.633353:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+44:15683:x1875740683542272:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788846184.633379:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.633408:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d561382732ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754aa1 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.633503:0:18618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d561382732b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.633572:0:18618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d561382732b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.633588:0:18618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d561382732b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846184.633644:0:18618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788846184.633668:0:18618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d561382732b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.633701:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d561382732ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa1 expref: 46 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.633722:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d561382732b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa1 expref: 45 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.633756:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:2.0:1788846184.633760:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788846184.633765:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaaa00, rc 0) 00000100:00100000:2.0:1788846184.633862:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+45:15683:x1875740683542272:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 509us (4128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.633869:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 66 00000100:00100000:2.0:1788846184.639956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.640050:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683542400 00000100:00100000:3.0:1788846184.640063:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683542400 00000100:00100000:3.0:1788846184.640141:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:3.0:1788846184.640163:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+6:2398:x1875740683542400:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846184.640185:0:18597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846184.640213:0:18597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754aa8 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788846184.640244:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fa068, blocks: 0x0 00010000:00010000:3.0:1788846184.640270:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=568s v=(0 0) 00010000:00010000:3.0:1788846184.640275:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846184.640286:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 7 pid: 18597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.640309:0:18597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 7 pid: 18597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.640325:0:18597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42cc00, rc 0) 00000100:00100000:3.0:1788846184.640613:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:2398:x1875740683542400:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 459us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846184.640640:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:1.0:1788846184.651204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.653808:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683542656 00000100:00100000:0.0:1788846184.653825:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683542656 00000100:00100000:0.0:1788846184.653898:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:0.0:1788846184.653908:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e34443bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+45:15683:x1875740683542656:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788846184.654085:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e34443bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+45:15683:x1875740683542656:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 178us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846184.654093:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 67 00000100:00100000:1.0:1788846184.658685:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.658835:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683542784 00000100:00100000:2.0:1788846184.658852:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683542784 00000100:00100000:2.0:1788846184.658952:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:2.0:1788846184.658966:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+45:15683:x1875740683542784:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788846184.665005:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788846184.665048:0:17068:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788846184.665143:0:17068:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788846184.665369:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+20:15683:x1875740683542784:12345-192.168.203.20@tcp:44:lhsmtool_posix.0 Request processed in 6397us (6685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.665382:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00010000:00010000:1.0:1788846184.665977:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.666006:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.666013:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.666019:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d600 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:1.0:1788846184.666024:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.666031:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.666047:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:1.0:1788846184.666050:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788846184.666055:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.666061:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d600/0x21b4d561382730d2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.669480:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702482176:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788846184.669506:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669550:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669559:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669567:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0d000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.669573:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669582:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669613:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90e451663700) 00010000:00010000:0.0:1788846184.669617:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.669623:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669630:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0d000/0x21b4d5613827307e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669669:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669676:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669692:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669698:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0c200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.669703:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669710:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669720:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:0.0:1788846184.669724:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.669728:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.669741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788846184.669741:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d56138273085 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669769:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669777:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669784:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669790:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c000 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.669794:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669812:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669825:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90e45176f400) 00010000:00010000:0.0:1788846184.669828:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.669832:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.669839:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c000/0x21b4d5613827312d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846184.669936:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702482176 00000100:00100000:3.0:1788846184.669946:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702482176 00000100:00100000:3.0:1788846184.670088:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788846184.670103:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702482176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788846184.670247:0:19094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788846184.670251:0:19094:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788846184.670253:0:19094:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788846184.670255:0:19094:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788846184 -> 1788846184 00002000:00010000:3.0:1788846184.670258:0:19094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788846184.670305:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875740702482176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 208us (639us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788846184.670314:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788846184.670324:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670344:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670350:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670356:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa200 already unused, calling callback (ffffffffc1a164f0) 00000100:00080000:1.0:1788846184.670360:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788846184.670360:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670373:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670384:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846184.670387:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.670390:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670406:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d561382731b2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670423:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670428:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670435:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670439:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaac00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.670442:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670687:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670697:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846184.670700:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.670703:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670708:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d561382731d5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670722:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670727:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670739:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670744:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42ce00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.670747:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670753:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670761:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846184.670764:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788846184.670767:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670772:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42ce00/0x21b4d5613827321b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670784:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670790:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670797:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670802:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42d200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.670804:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670822:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670830:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:0.0:1788846184.670832:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788846184.670835:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.670840:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42d200/0x21b4d561382732a0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788846184.673485:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90e474667100/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788846184.673499:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702482176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788846184.673829:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.674112:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683542912 00000100:00100000:2.0:1788846184.674124:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683542912 00000100:00100000:2.0:1788846184.674195:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:2.0:1788846184.674208:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e44704bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:2398:x1875740683542912:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788846184.674477:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e44704bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:2398:x1875740683542912:12345-192.168.203.20@tcp:16:lhsmtool_posix.0 Request processed in 270us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.674486:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:1.0:1788846184.681141:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.681231:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683543168 00000100:00100000:0.0:1788846184.681250:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683543168 00000100:00100000:0.0:1788846184.681355:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1788846184.681368:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+14:15683:x1875740683543168:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788846184.681444:0:17088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788846184.681480:0:17088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d561382732b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa1 expref: 14 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.681502:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:0.0:1788846184.681508:0:17088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788846184.681594:0:17088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.681612:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.681625:0:17088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788846184.681812:0:17088:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097a9a4f6 reply state 0000000007cfef8d transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.681828:0:17088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0c200/0x21b4d561382732c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.681835:0:17088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:0.0:1788846184.681838:0:17088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788846184.681852:0:17088:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788846184.682427:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+15:15683:x1875740683543168:12345-192.168.203.20@tcp:36:lhsmtool_posix.0 Request processed in 1057us (1293us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788846184.682436:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:0.0:1788846184.684947:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.685144:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683543296 00000100:00100000:3.0:1788846184.685157:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683543296 00000100:00100000:3.0:1788846184.685233:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1788846184.685246:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47467b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:15683:x1875740683543296:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788846184.685268:0:18597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788846184.685292:0:18597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754aaf expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.685333:0:18597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 8 pid: 18597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.685468:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846184.685491:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788846184.685498:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.685593:0:18597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 8 pid: 18597 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.685608:0:18597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 8 pid: 18597 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846184.685623:0:18597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474664a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18597:1875740702482304:192.168.203.20@tcp:104: 00000100:00100000:3.0:1788846184.685722:0:18597:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e343807b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788846184.694839:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.694950:0:18597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474664a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18597:1875740702482304:192.168.203.20@tcp:104: 00000100:00100000:1.0:1788846184.694990:0:20117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683543424 00000100:00100000:1.0:1788846184.695000:0:20117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683543424 00010000:00010000:2.0:1788846184.695004:0:18597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.695034:0:18597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e46d42da00, rc 0) 00010000:00010000:1.0:1788846184.695052:0:20117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 9 pid: 18597 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.695106:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47467b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:15683:x1875740683543296:12345-192.168.203.20@tcp:101:lhsmtool_posix.0 Request processed in 9862us (10172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846184.695141:0:20117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:1.0:1788846184.695153:0:20117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:2399:x1875740683543424:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788846184.695203:0:20117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788846184.695240:0:20117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 9 pid: 18597 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.695255:0:20117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 9 pid: 18597 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.695285:0:20117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000255c21e7/0x21b4d561382732bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aa8 expref: 9 pid: 18597 timeout: 668 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.695301:0:20117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846184.695306:0:20117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788846184.695313:0:20117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.695324:0:20117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.695363:0:20117:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846184.695379:0:20117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:20117:1875740702482432:192.168.203.20@tcp:105: 00000100:00100000:1.0:1788846184.695460:0:20117:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e450e57000 going to sleep for 11 seconds 00000100:00100000:2.0:1788846184.695830:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:3.0:1788846184.698671:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846184.698691:0:20117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:20117:1875740702482432:192.168.203.20@tcp:105: 00010000:00010000:1.0:1788846184.698727:0:20117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788846184.698814:0:19094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683543552 00000100:00100000:0.0:1788846184.698823:0:19094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683543552 00000100:00100000:1.0:1788846184.698826:0:20117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474664000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:2399:x1875740683543424:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 3672us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846184.698839:0:20117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 20 00000100:00100000:0.0:1788846184.698898:0:19094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788846184.698908:0:19094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:2398:x1875740683543552:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788846184.699122:0:19094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788846184.699126:0:19094:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788846184 00002000:00010000:0.0:1788846184.699129:0:19094:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788846183 00002000:00010000:0.0:1788846184.699131:0:19094:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788846184 -> 1788846184 00002000:00010000:0.0:1788846184.699134:0:19094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788846184.699162:0:19094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:2398:x1875740683543552:12345-192.168.203.20@tcp:2:lhsmtool_posix.0 Request processed in 255us (505us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788846184.699169:0:19094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:0.0:1788846184.706899:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.707317:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683543680 00000100:00100000:2.0:1788846184.707331:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683543680 00000100:00100000:2.0:1788846184.707425:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1788846184.707437:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:2401:x1875740683543680:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788846184.707498:0:19458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.707578:0:19458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.707591:0:19458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846184.707597:0:19458:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788846184.707603:0:19458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.707667:0:19458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.707695:0:19458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 8 pid: 18597 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.707714:0:19458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19458:1875740702482560:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846184.707820:0:19458:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342968480 going to sleep for 11 seconds 00000100:00100000:1.0:1788846184.710462:0:19458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19458:1875740702482560:192.168.203.20@tcp:104: 00010000:00010000:1.0:1788846184.710499:0:19458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846184.712751:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.717188:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683543808 00000100:00100000:3.0:1788846184.717210:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683543808 00010000:00010000:3.0:1788846184.717279:0:17075:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 9 pid: 18597 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.717903:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 21 00000100:00100000:2.0:1788846184.717930:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+9:2399:x1875740683543808:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788846184.717954:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788846184.717985:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 9 pid: 18597 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.718002:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 9 pid: 18597 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.718033:0:17074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006600a381/0x21b4d561382732ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754aaf expref: 9 pid: 18597 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.718056:0:17074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788846184.718060:0:17074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788846184.718067:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.718098:0:17074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.718143:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788846184.718228:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:2399:x1875740683543808:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 313us (5490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.718236:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 21 00010000:00010000:1.0:1788846184.718411:0:19458:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.718421:0:19458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.718446:0:19458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.718454:0:19458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.718462:0:19458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.718469:0:19458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab400 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846184.718473:0:19458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.718498:0:19458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.718512:0:19458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.718568:0:19458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf51017a/0x21b4d561382732d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788846184.718626:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:2401:x1875740683543680:12345-192.168.203.20@tcp:1:lhsmtool_posix.0 Request processed in 11192us (11751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846184.718635:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 26 00000100:00100000:2.0:1788846184.724794:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.725062:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683544064 00000100:00100000:0.0:1788846184.725076:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683544064 00000100:00100000:0.0:1788846184.725156:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:0.0:1788846184.725168:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+15:15683:x1875740683544064:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788846184.725274:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.725295:0:17089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.725306:0:17089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.725349:0:17089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 15 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.725365:0:17089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 15 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846184.725383:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474678380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1875740702482688:192.168.203.20@tcp:104: 00000100:00100000:0.0:1788846184.725500:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788846184.731602:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474678380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1875740702482688:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846184.731644:0:17089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846184.732342:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.733656:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683544192 00000100:00100000:3.0:1788846184.733673:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683544192 00010000:00010000:3.0:1788846184.733734:0:17073:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 16 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846184.733850:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:3.0:1788846184.733863:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+16:2398:x1875740683544192:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846184.733880:0:17073:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846184.733926:0:17073:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 16 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.733941:0:17073:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 16 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.733970:0:17073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0da00/0x21b4d561382731ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a4d expref: 16 pid: 17089 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.733993:0:17073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846184.734000:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 15 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.734011:0:17073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.734019:0:17073:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.734028:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.734066:0:17073:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846184.734153:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+15:2398:x1875740683544192:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 293us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846184.734161:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00010000:00010000:2.0:1788846184.734235:0:17089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.734245:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.734556:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.734572:0:17089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 15 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.734580:0:17089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.734619:0:17089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 15 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.734642:0:17089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 15 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.734658:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1875740702482816:192.168.203.20@tcp:104: 00000100:00100000:2.0:1788846184.734731:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e342968480 going to sleep for 11 seconds 00000100:00100000:0.0:1788846184.739321:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846184.739882:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683544320 00000100:00100000:3.0:1788846184.739905:0:17074:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683544320 00010000:00010000:3.0:1788846184.739965:0:17074:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 16 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846184.740046:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788846184.740059:0:17074:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f27e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+16:2399:x1875740683544320:12345-192.168.203.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788846184.740080:0:17074:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788846184.740088:0:17074:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 16 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.740104:0:17074:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 16 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.740135:0:17074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:3.0:1788846184.740141:0:17074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.740154:0:17074:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.740164:0:17074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.740189:0:17074:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788846184.740257:0:17074:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f27e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+16:2399:x1875740683544320:12345-192.168.203.20@tcp:103:ldlm_bl.0 Request processed in 200us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846184.740265:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 00010000:00010000:2.0:1788846184.741634:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa800/0x21b4d561382732a7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a9a expref: 15 pid: 18618 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.741665:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1875740702482816:192.168.203.20@tcp:104: 00010000:00010000:2.0:1788846184.741694:0:17089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.741705:0:17089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.741710:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788846184.741994:0:17089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788846184.742142:0:17089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788846184.742182:0:17089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788846184.742285:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17089:1875740702482944:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788846184.743033:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846184.743129:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e4495419c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788846184.743412:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702482944 00000100:00100000:3.0:1788846184.743422:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702482944 00000100:00100000:3.0:1788846184.743547:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788846184.743559:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17089:x1875740702482944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788846184.743690:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17089:x1875740702482944:12345-0@lo:1000:mdt00_001.0 Request processed in 133us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846184.743698:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788846184.743779:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17089:1875740702482944:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788846184.744022:0:17089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788846184.744105:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47467b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17089:1875740702483072:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788846184.744160:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788846184.744387:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d1870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788846184.744575:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702483072 00000100:00100000:2.0:1788846184.744582:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702483072 00000100:00100000:2.0:1788846184.744618:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788846184.744635:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17089:x1875740702483072:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788846184.744799:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17089:x1875740702483072:12345-0@lo:1000:mdt00_001.0 Request processed in 166us (639us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788846184.744807:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788846184.744902:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47467b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17089:1875740702483072:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788846184.744958:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.744972:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.744980:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.744986:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.744991:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745000:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745021:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:0.0:1788846184.745024:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846184.745030:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745037:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d561382732df lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745077:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745084:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745099:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745105:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42c800 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:0.0:1788846184.745108:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745115:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745126:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:0.0:1788846184.745129:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788846184.745137:0:17089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745149:0:17089:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745158:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.745228:0:17089:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0de00/0x21b4d5613827323e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754a7e expref: 18 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846184.745243:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e47467a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1875740702483200:192.168.203.20@tcp:105: 00000100:00100000:0.0:1788846184.745332:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff90e47d187300 going to sleep for 11 seconds 00000100:00100000:0.0:1788846184.749042:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.749078:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683544448 00000100:00100000:0.0:1788846184.749099:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683544448 00000100:00100000:3.0:1788846184.749418:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e47467a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17089:1875740702483200:192.168.203.20@tcp:105: 00010000:00010000:3.0:1788846184.749456:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749469:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42c800/0x21b4d56138273237 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749509:0:17089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749558:0:17089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749574:0:17089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749586:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749593:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749601:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749608:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e46d42cc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846184.749612:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749635:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749651:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846184.749654:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788846184.749658:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749664:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e46d42cc00/0x21b4d561382732e6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749674:0:17089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749681:0:17089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749687:0:17089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749692:0:17089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0cc00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:3.0:1788846184.749696:0:17089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749703:0:17089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749710:0:17089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:3.0:1788846184.749713:0:17089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788846184.749716:0:17089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788846184.749732:0:17089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0cc00/0x21b4d561382732d8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788846184.750026:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+19:15683:x1875740683544064:12345-192.168.203.20@tcp:57:lhsmtool_posix.0 Request processed in 24858us (25244us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788846184.750038:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000020:00080000:3.0:1788846184.750044:0:17089:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788846184.750365:0:17124:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788846184.750370:0:17124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788846184.750391:0:17124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788846184.750398:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788846184.752710:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846184.753210:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683544704 00000100:00100000:0.0:1788846184.753224:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683544704 00000100:00100000:0.0:1788846184.753278:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1788846184.753290:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+19:15682:x1875740683544448:12345-192.168.203.20@tcp:49:bash.0 00000100:00100000:0.0:1788846184.753587:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+19:15682:x1875740683544448:12345-192.168.203.20@tcp:49:bash.0 Request processed in 299us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846184.753596:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 12 00000100:00100000:0.0:1788846184.753619:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 13 00000100:00100000:0.0:1788846184.753627:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+18:15683:x1875740683544704:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788846184.754067:0:17092:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788846184.754108:0:17092:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1788846184.754153:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.754175:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.754187:0:17092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.754197:0:17092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.754204:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.754211:0:17092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788846184.754310:0:17092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788846184.754391:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+20:15683:x1875740683544704:12345-192.168.203.20@tcp:35:lhsmtool_posix.0 Request processed in 764us (1693us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1788846184.754400:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 13 00000020:00080000:0.0:1788846184.754405:0:17092:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788846184.756887:0:17076:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788846184.756907:0:17076:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788846184.756931:0:17076:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342a0ca00 already unused, calling callback (ffffffffc0e05350) 00010000:00010000:1.0:1788846184.756936:0:17076:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788846184.756953:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00010000:00010000:1.0:1788846184.757017:0:17076:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.757063:0:18597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683544832 00010000:00010000:1.0:1788846184.757064:0:17076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90e451663a00) 00010000:00010000:1.0:1788846184.757070:0:17076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788846184.757076:0:17076:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.757078:0:18597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683544832 00010000:00010000:1.0:1788846184.757086:0:17076:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342a0ca00/0x21b4d561382732ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.757157:0:18597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 27 00010000:00010000:0.0:1788846184.757163:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846184.757166:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788846184.757169:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788846184.757171:0:18597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47467ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+7:15682:x1875740683544832:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846184.757194:0:18597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.757219:0:18597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce462d7b/0x21b4d561382732f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754ab6 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788846184.757249:0:18597:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9fa068, atime: 0x6a9fa067, ctime: 0x6a9fa068, blocks: 0x0 00010000:00010000:2.0:1788846184.757277:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=568s v=(0 0) 00010000:00010000:2.0:1788846184.757282:0:18597:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788846184.757294:0:18597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce462d7b/0x21b4d561382732f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ab6 expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.757311:0:18597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce462d7b/0x21b4d561382732f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ab6 expref: 8 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.757324:0:18597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaa800, rc 0) 00000100:00100000:2.0:1788846184.757407:0:18597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47467ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:15682:x1875740683544832:12345-192.168.203.20@tcp:101:bash.0 Request processed in 240us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.757415:0:18597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 27 00000100:00100000:3.0:1788846184.761143:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.761265:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683544960 00000100:00100000:2.0:1788846184.761302:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683544960 00000100:00100000:2.0:1788846184.761382:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:2.0:1788846184.761395:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+20:15682:x1875740683544960:12345-192.168.203.20@tcp:101:bash.0 00010000:00010000:2.0:1788846184.761425:0:17090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.761451:0:17090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d561382732fb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754abd expref: -99 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.761494:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273302 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.761511:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273302 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.761572:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273302 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.761714:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d561382732fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754abd expref: 22 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.761739:0:17090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaac00/0x21b4d56138273302 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754abd expref: 21 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.761749:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846184.761753:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788846184.761758:0:17090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaac00, rc 0) 00000100:00100000:2.0:1788846184.761839:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+21:15682:x1875740683544960:12345-192.168.203.20@tcp:101:bash.0 Request processed in 447us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.761847:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:3.0:1788846184.764199:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702483328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788846184.764283:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846184.764631:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702483328 00000100:00100000:2.0:1788846184.764660:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702483328 00000100:00100000:2.0:1788846184.764740:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846184.764751:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702483328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788846184.764789:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788846184.764850:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875740702483328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.764858:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788846184.764937:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3643:1875740702483328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788846184.765123:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788846184.768783:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.768912:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683545216 00000100:00100000:2.0:1788846184.768934:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683545216 00000100:00100000:2.0:1788846184.769006:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 14 00000100:00100000:2.0:1788846184.769018:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+21:15682:x1875740683545216:12345-192.168.203.20@tcp:35:bash.0 00000001:00080000:2.0:1788846184.769310:0:17091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788846184.769433:0:17091:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788846184.769622:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+24:15682:x1875740683545216:12345-192.168.203.20@tcp:35:bash.0 Request processed in 604us (849us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788846184.769632:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 14 00000020:00080000:2.0:1788846184.769638:0:17091:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788846184.870215:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.870355:0:18618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683545472 00000100:00100000:2.0:1788846184.870370:0:18618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683545472 00000100:00100000:2.0:1788846184.870450:0:18618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:2.0:1788846184.870463:0:18618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+24:15693:x1875740683545472:12345-192.168.203.20@tcp:101:lfs.0 00010000:00010000:2.0:1788846184.870497:0:18618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788846184.870724:0:18618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273309 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc1a0ecc621754ac4 expref: -99 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788846184.870860:0:18618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788846184.871234:0:18618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273309 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ac4 expref: 26 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.871254:0:18618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90e46d443b00) 00010000:00010000:2.0:1788846184.871257:0:18618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788846184.871263:0:18618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaaa00/0x21b4d56138273309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.20@tcp remote: 0xc1a0ecc621754ac4 expref: 26 pid: 18618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.871283:0:18618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90e342aaaa00, rc 0) 00000100:00100000:2.0:1788846184.871681:0:18618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53da1059-0b4b-4ba8-a35c-806ac864d7eb+25:15693:x1875740683545472:12345-192.168.203.20@tcp:101:lfs.0 Request processed in 1219us (1480us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788846184.871691:0:18618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 72 00000100:00100000:3.0:1788846184.875473:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.875629:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683545600 00000100:00100000:2.0:1788846184.875643:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683545600 00000100:00100000:2.0:1788846184.875716:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:2.0:1788846184.875728:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+25:15693:x1875740683545600:12345-192.168.203.20@tcp:34:lfs.0 00010000:00010000:2.0:1788846184.875834:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.875871:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.875885:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.875922:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.875930:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.875956:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876049:0:17090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876059:0:17090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876066:0:17090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788846184.876130:0:17090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876147:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876154:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876162:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876168:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaa200 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846184.876173:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876182:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876196:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90e451663d00) 00010000:00010000:2.0:1788846184.876208:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846184.876215:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876222:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaa200/0x21b4d56138273317 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876242:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876248:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876254:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876259:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aab400 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846184.876262:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876268:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876276:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90e46d443900) 00010000:00010000:2.0:1788846184.876278:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846184.876281:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876287:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aab400/0x21b4d5613827331e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876304:0:17090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876316:0:17090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876322:0:17090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876328:0:17090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90e342aaba00 already unused, calling callback (ffffffffc1a164f0) 00010000:00010000:2.0:1788846184.876331:0:17090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876338:0:17090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876346:0:17090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90e45176f900) 00010000:00010000:2.0:1788846184.876349:0:17090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788846184.876352:0:17090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788846184.876357:0:17090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90e342aaba00/0x21b4d56138273325 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788846184.876459:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53da1059-0b4b-4ba8-a35c-806ac864d7eb+25:15693:x1875740683545600:12345-192.168.203.20@tcp:34:lfs.0 Request processed in 731us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846184.876468:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 73 00000100:00100000:0.0:1788846184.880265:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:2.0:1788846184.880367:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683545856 00000100:00100000:2.0:1788846184.880380:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683545856 00000100:00100000:2.0:1788846184.880449:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 15 00000100:00100000:2.0:1788846184.880462:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+25:15693:x1875740683545856:12345-192.168.203.20@tcp:35:lfs.0 00000100:00100000:2.0:1788846184.880783:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+26:15693:x1875740683545856:12345-192.168.203.20@tcp:35:lfs.0 Request processed in 323us (532us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788846184.880810:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 15 00010000:00010000:3.0:1788846185.147009:0:17077:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788846185.274134:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788846185.274166:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702483456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788846185.274273:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846185.274962:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702483456 00000100:00100000:2.0:1788846185.274974:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702483456 00000100:00100000:2.0:1788846185.275048:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788846185.275059:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702483456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788846185.275103:0:17829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788846185.275168:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702483456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846185.275174:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788846185.275608:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702483584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788846185.275646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788846185.275703:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702483456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788846185.275814:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702483584 00000100:00100000:1.0:1788846185.275819:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702483584 00000100:00100000:1.0:1788846185.275858:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788846185.275866:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e474666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702483584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788846185.275889:0:17094:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788846185.275941:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e474666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875740702483584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846185.275948:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788846185.275977:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702483584:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788846186.171925:0:17844:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788846186.250368:0:20267:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1788846186.297746:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788846186.297842:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788846186.297930:0:19095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702483712 00000100:00100000:2.0:1788846186.297939:0:19095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702483712 00000100:00100000:2.0:1788846186.298009:0:19095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788846186.298020:0:19095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702483712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788846186.298060:0:19095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788846186.298116:0:19095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e475c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702483712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846186.298124:0:19095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788846186.298149:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788846186.298197:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e475c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788846186.298314:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788846186.298324:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702483840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846186.298357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.298391:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702483840 00000100:00100000:1.0:1788846186.298394:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702483840 00000100:00100000:1.0:1788846186.298427:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788846186.298435:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702483840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788846186.298456:0:18600:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788846186.298490:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875740702483840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.298496:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788846186.298512:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788846186.298561:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3642:1875740702483840:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788846186.299192:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788846186.299207:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e474664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702483968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788846186.299248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.299663:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e4437a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702484096:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.299700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.299726:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702484608:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.299753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.299771:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702485120:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.299796:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.299818:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788846186.299824:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702484480:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.299848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.299867:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702484992:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.299889:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.299928:0:18595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702484608 00000100:00100000:1.0:1788846186.299936:0:18595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702484608 00000100:00100000:1.0:1788846186.299994:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788846186.300003:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702484608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300053:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702484608:12345-0@lo:400:kworker.0 Request processed in 51us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.300068:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788846186.300093:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702485120 00000100:00100000:1.0:1788846186.300097:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702485120 00000100:00100000:1.0:1788846186.300122:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702484992 00000100:00100000:1.0:1788846186.300126:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702484992 00000100:00100000:1.0:1788846186.300151:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788846186.300157:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702485120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300193:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875740702485120:12345-0@lo:400:kworker.0 Request processed in 36us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.300199:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788846186.300212:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788846186.300218:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702484992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300245:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875740702484992:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.300252:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788846186.300271:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702484480 00000100:00100000:1.0:1788846186.300275:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702484480 00000100:00100000:1.0:1788846186.300301:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788846186.300307:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702484480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300340:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e47d3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875740702484480:12345-0@lo:400:kworker.0 Request processed in 34us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.300347:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788846186.300374:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788846186.300378:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846186.300381:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846186.300392:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702484224:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300421:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.300449:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702484736:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300474:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.300490:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702485248:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300512:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.300552:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788846186.300559:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702484352:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300585:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.300596:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702484864:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300619:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788846186.300640:0:17829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702484224 00000100:00100000:1.0:1788846186.300644:0:17829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702484224 00000100:00100000:1.0:1788846186.300669:0:17829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788846186.300675:0:17829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702484224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300708:0:17829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875740702484224:12345-0@lo:400:kworker.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.300715:0:17829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788846186.300731:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702484736 00000100:00100000:1.0:1788846186.300734:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702484736 00000100:00100000:1.0:1788846186.300750:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702485248 00000100:00100000:1.0:1788846186.300752:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702485248 00000100:00100000:1.0:1788846186.300772:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702484352 00000100:00100000:1.0:1788846186.300775:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702484352 00000100:00100000:1.0:1788846186.300786:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702484864 00000100:00100000:1.0:1788846186.300788:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702484864 00000100:00100000:1.0:1788846186.300806:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788846186.300811:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702484736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300843:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875740702484736:12345-0@lo:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.300861:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788846186.300874:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788846186.300880:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702485248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300922:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e344438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875740702485248:12345-0@lo:400:kworker.0 Request processed in 43us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.300928:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788846186.300939:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788846186.300945:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702484352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.300969:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875740702484352:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.300975:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788846186.300985:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788846186.300990:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702484864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.301015:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875740702484864:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846186.301020:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788846186.301034:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846186.301037:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788846186.301075:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702484480:0@lo:400:kworker.0 00010000:00080000:1.0:1788846186.301093:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3ece00 x1875740702484992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846186.301106:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3641:1875740702484992:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.301119:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3641:1875740702484608:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.301130:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3641:1875740702485120:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.301177:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875740702484352:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.301186:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3642:1875740702484864:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.301194:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3642:1875740702484224:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.301201:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875740702484736:0@lo:400:kworker.0 00010000:00080000:1.0:1788846186.301210:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90e46f3ec380 x1875740702485248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788846202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788846186.301217:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e46f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3642:1875740702485248:0@lo:400:kworker.0 00000100:00100000:3.0:1788846186.301335:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702483968 00000100:00100000:3.0:1788846186.301341:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702483968 00000100:00100000:3.0:1788846186.301385:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788846186.301393:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702483968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788846186.301421:0:18599:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788846186.301465:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1875740702483968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846186.301479:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788846186.301813:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740702484096 00000100:00100000:2.0:1788846186.301819:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740702484096 00000100:00100000:2.0:1788846186.301854:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788846186.301862:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3641:x1875740702484096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788846186.301919:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6db0807f-6150-4b75-b37b-0ed71f62ed94+24:3641:x1875740702484096:12345-0@lo:400:kworker.0 Request processed in 57us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788846186.301926:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1788846186.302562:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788846186.302601:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e4437a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6db0807f-6150-4b75-b37b-0ed71f62ed94:3641:1875740702484096:0@lo:400:kworker.0 00000100:00100000:1.0:1788846186.302626:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90e474664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3641:1875740702483968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788846187.193744:0:17076:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788846187.379878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846187.379934:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846187.379959:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846187.379979:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846187.379997:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:3.0:1788846187.380105:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683545984 00000100:00100000:3.0:1788846187.380118:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683545984 00000100:00100000:1.0:1788846187.380213:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846187.380240:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846187.380269:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:1.0:1788846187.380297:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.20@tcp (source: 12345-192.168.203.20@tcp) 00000100:00100000:0.0:1788846187.380329:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683546496 00000100:00100000:1.0:1788846187.380330:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683546240 00000100:00100000:1.0:1788846187.380335:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683546240 00000100:00100000:0.0:1788846187.380347:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683546496 00000100:00100000:1.0:1788846187.380396:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683546752 00000100:00100000:1.0:1788846187.380402:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683546752 00000100:00100000:0.0:1788846187.380441:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683547008 00000100:00100000:1.0:1788846187.380444:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683546112 00000100:00100000:0.0:1788846187.380448:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683547008 00000100:00100000:1.0:1788846187.380465:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683546112 00000100:00100000:0.0:1788846187.380476:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683546368 00000100:00100000:0.0:1788846187.380483:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683546368 00000100:00100000:0.0:1788846187.380515:0:19458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683546880 00000100:00100000:1.0:1788846187.380547:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875740683546624 00000100:00100000:0.0:1788846187.380552:0:19458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683546880 00000100:00100000:1.0:1788846187.380554:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875740683546624 00000100:00100000:0.0:1788846187.380597:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:1.0:1788846187.380606:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:0.0:1788846187.380620:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2399:x1875740683546496:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846187.380625:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2399:x1875740683546240:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846187.380709:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2399:x1875740683546496:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 94us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846187.380718:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 22 00000100:00100000:0.0:1788846187.380738:0:19458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 23 00000100:00100000:3.0:1788846187.380971:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:3.0:1788846187.380984:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e45028d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2399:x1875740683545984:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846187.381046:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e343a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+5:2399:x1875740683546240:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 427us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846187.381054:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 68 00000100:00100000:1.0:1788846187.381074:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:1.0:1788846187.381080:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e4437a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2399:x1875740683546752:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846187.381106:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e4437a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2399:x1875740683546752:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 27us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846187.381113:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 69 00000100:00100000:1.0:1788846187.381124:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:1.0:1788846187.381130:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+26:2399:x1875740683546112:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846187.381159:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53da1059-0b4b-4ba8-a35c-806ac864d7eb+26:2399:x1875740683546112:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 30us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846187.381166:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 70 00000100:00100000:1.0:1788846187.381177:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:1.0:1788846187.381183:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2399:x1875740683546624:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846187.381206:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e9c95b52-bf21-4a43-abed-5b176d36d076+6:2399:x1875740683546624:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 23us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846187.381212:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 71 00000100:00100000:1.0:1788846187.381238:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1788846187.381246:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:2399:x1875740683546368:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846187.381286:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53da1059-0b4b-4ba8-a35c-806ac864d7eb+8:2399:x1875740683546368:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 41us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846187.381292:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 24 00000100:00100000:1.0:1788846187.381307:0:18595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00100000:1.0:1788846187.381313:0:18595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2399:x1875740683546880:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:1.0:1788846187.381336:0:18595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2399:x1875740683546880:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 22us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788846187.381342:0:18595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 25 00000100:00080000:1.0:1788846187.381360:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788846187.381366:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788846187.381368:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788846187.381372:0:17084:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788846187.381470:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e45028d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a7b5cd26-e654-4a7c-b591-2ded2c0f1e54+13:2399:x1875740683545984:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 489us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788846187.381478:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 167 00000100:00100000:0.0:1788846187.383058:0:19458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2399:x1875740683547008:12345-192.168.203.20@tcp:400:kworker.0 00000100:00100000:0.0:1788846187.383159:0:19458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90e46f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e9c95b52-bf21-4a43-abed-5b176d36d076+5:2399:x1875740683547008:12345-192.168.203.20@tcp:400:kworker.0 Request processed in 2411us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788846187.383169:0:19458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.20@tcp, seq: 23 Debug log: 42117 lines, 42117 kept, 0 dropped, 0 bad.